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Abstract 

Adaptive randomly reinforced urn (ARRU) is a two-color urn model where the updating 
process is defined by a sequence of non-negative random vectors {(Di : n, D 2 ,n); n > 1} and 
randomly evolving thresholds which utilize accruing statistical information for the updates. Let 
mi = E[Di } n] and m 2 = E[D2,n\- Motivated by applications, in this paper we undertake a 
detailed study of the dynamics of the ARRU model. First, for the case mi ^ m 2 , we establish 
Li bounds on the increments of the urn proportion at fixed and increasing times under very weak 
assumptions on the random threshold sequence. As a consequence, we deduce weak consistency 
of the evolving urn proportions. Second, under slightly stronger conditions, we establish the 
strong consistency of the urn proportions for all finite values of mi and m 2 . Specifically, we show 
that when mi = m 2 the proportion converges to a non-degenerate random variable. Third, we 
establish the asymptotic distribution, after appropriate centering and scaling, of the proportion 
of sampled balls in the case mi = m 2 . In the process, we settle the issue of asymptotic 
distribution of the number of sampled balls for a randomly reinforced urn (RRU). To address 
the technical issues, we establish results on the harmonic moments of the total number of balls 
in the urn at different times under very weak conditions, which is of independent interest. 
Keywords: generalized Polya urn, reinforced processes, strong and weak consistency, central 
limit theorems, crossing times, harmonic moments. 
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1 Introduction 

In recent years, randomly reinforced urn (RRU) has been investigated in statistical and prob¬ 
ability literature as a model for clinical trial design, computer experiments and in the context 
of vertex reinforced random walk (see | 12l 1131 fl6| L Introduction of accruing information in the 
implementation of these urn models in practice, leads to an adaptive randomly reinforced urn 


1 


(ARRU). In this paper, we study the properties concerning the urn composition of an ARRU. 
We now turn to a precise description of the ARRU. 

A randomly reinforced urn (RRU) model (see [153) is characterized by a pair Y 2 , n ) of 

real random variables representing the number of balls of two colors, red and white. The process 
is described as follows: at time n = 0, the process starts with (yi : o, 2 / 2 , 0 ) balls. A ball is drawn at 
random. If the color is red, the ball is returned to the urn along with the random numbers Di,i 
of red balls; otherwise, the ball is returned to the urn along with the random numbers £> 2,1 of 
white balls. Let Yi,i = 1 / 1,0 + Z?i,i and Vgi = 1 / 2,0 denote the urn composition when the sampled 
ball is red; similarly, let Yi,i = 1 / 1,0 and Y 2.1 = 1 / 2,0 + D 2 p denote the urn composition when 
the sampled ball is white. The process is repeated yielding the collection {(Yf, n , Y 2irl ); n > 1 }. 
The quantities {Di, n ;n > 1} and (D 2 ,„;n > 1} are independent collections of independent 
and identically distributed (i.i.d.) non-negative random variables. Hence, an RRU model is 
characterized by the replacement matrix 


D n = 


Di, 

0 


0 

D 2 , 


Let mi := E[D i,„] and m 2 := E[D 2tTl \. The asymptotic properties of the urn composition in the 
above model were investigated by Muliere et al. (see [15]) and Aletti et al. (see my specifically, 
they established that 


Z n — 


Yu 


Y Un + Y 2 , 


if mi > m 2 , 
if mi = m 2 , 
if mi < m 2 , 


( 1 . 1 ) 


where stands for almost sure convergence and Zoo is a non-degenerate random variable 
supported on (0,1). The properties of the distribution of Zoo were studied in Aletti et al. 
(see DEI). Specifically, it is shown in Aletti et al. (see m) that when mi = m 2 , P(Z 00 = x) = 0 
for any x £ [0,1]. Denoting {(lVi, n ,lV 2 , n ); n > 1} the number of balls of red and white colors 
sampled from the urn, one can deduce from (1.1) that Ni. n /n converges to the same limit as 

Z n - 

Notice that the limit of the RRU in cnj is always 1 or 0 when mi 4 m 2 , and the rate 
of convergence and the limit distribution has been established in May and Flournoy (2009) 
(see [14]). However, motivated by applications in clinical trials (see my it is common to target 
a specific value p £ (0,1). This was achieved in Aletti et al. (see [3]), where the modified 
randomly reinforced urn (MRRU) model was introduced. The MRRU model is an RRU model 
with two fixed thresholds 0 < p 2 < pi < 1, such that if Z n < p 2 , no white balls are replaced in 
urn, while if Z n > pi, no red balls are replaced in the urn. The replacement matrix in this case 
is 

Dl, n ■ 0 

0 D 2 , n ■ 1 {z n _ 1 > P2 y 

The strong consistency in the case mi 4 m 2 was established in Aletti et al. (see my i-e. they 


D n = 


2 








showed that 


z n 4 ' 


pi if mi > m 2 , 
p 2 if m 1 < m 2 . 


( 1 . 2 ) 


A second order result for Z n , namely the asymptotic distribution of Z n after appropriate cen¬ 
tering, was derived in Ghiglietti et al. (see m- 

In applications, especially in clinical trials (see [12]), pi and p 2 are unknown and depend 
on the parameters of the distributions of D ip and Z> 2 , 1 . Let T r ~ 1 be the n-algebra generated 
by the information up to time n — 1 and let pi, n -i and p2,n-i be two random variables that 
are _F n -i-measurable. Ghiglietti et al. proposed in [TO] an adaptive randomly reinforced urn 
model that uses accruing information to construct random thresholds pi,n-i and p2, n -i which 
converge a.s. to specified targets pi and p 2 - Thus, using the replacement matrix 


D„ 


Dl.n ' i} 

0 


0 

D2,n ' l{Z n _ 1 >p2,n- 1 } 


(1.3) 


an MRRU becomes an Adaptive Randomly Reinforced Urn (ARRU). It is worth mentioning 
here that the random thresholds pi,n-i and p2,n-i depend on the adaptive estimators of the 
parameters of the distributions of D 1,1 and D2.1 ■ 

In a recent work, Ghiglietti et al. (see [101 1 studied the asymptotic properties of an ARRU 
when mi m 2 under strong conditions on the rate of convergence of the adaptive thresholds. 
Specifically, they established a strong consistency and asymptotic normality for the number 
of sampled balls under an exponential rate of convergence assumption on the adaptive thresh¬ 
olds. In this paper, first we establish that under very weak conditions, weak consistency of 
the proportion Z n . This is achieved by providing useful and non-trivial L\ bounds on (i) the 
increments of the distace A n = \Z n — pi| (Theorem 14.211 and (ii) the increments of A n at linearly 
increasing times (Theorem 14.51 and Theorem l4.6l) . These results provide insight into the dynam¬ 
ics of the ARRU and are of independent interest. The proofs of these results need estimates 
on the harmonic moments of the total number of balls in the urn under weak assumptions on 
the thresholds. This result, of independent interest, is established in Theorem 14.II Second, we 
undertake a detailed analysis of the ARRU model when mi = m 2 . Specifically, we establish 
strong consistency of the proportion Z„ and the limit distribution of the proportion of sampled 
balls for the ARRU. In the process, we also address the issue of limit distribution of the number 
of sampled balls from a randomly reinforced urn (RRU) thus settling one of the long-standing 
open problems in the field. 

The rest of the paper is structured as follows: Section[2]contains the model, assumptions and 
main results; Section [3] is concerned with preliminary estimates and results on the urn process. 
Sections [4] and [5] are concerned with the proofs of the consistency of the urn proportion and 
Section[6]is concerned with the proof of the limit distribution of the proportion of sampled balls. 
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2 Model assumptions, notation and main results 


We begin by describing our model precisely. Let £1 = {£1 ,„;n > 1 } and £2 = {£2 |Tl ;n > 1 } be 
two sequences of i.i.d. random variables, with probability distributions pi and p2 respectively. 
Without loss of generality (wlog), assume that the support of £i, n and £2 , n is the same. We 
denote it by S. Consider an urn containing 1/1,0 > 0 red balls and 1/2,0 > 0 white balls, and 
define yo = 1/1,0+ 1/2,0 and zq = yg 1 yi,o- In general, 1/1,0 and 1/2,0 may not assume integer values. 
At time n = 1 , a ball is drawn at random from the urn and its color is observed. Let the random 
variable Ai be such that 

{ 1 if the extracted ball is red, 

0 if the extracted ball is white. 

We assume Ai to be independent of the sequences £1 and £2- To make this assumption more 
explicit, we define X\ = 1 {e/;l<.z 0 }, where U\ is a uniform random variable in ( 0 , 1 ) independent 
of £1 and £2■ Note that Ai Bernoulli random variable with parameter zo- 

Let pi,o and p 2,0 be two random variables such that pi,o,p2,o £ [ 0 , 1 ] and pi,o > P2,o- Let 
u : S —> [a, 6], 0 < a < b < 00. If Ai = 1 and z 0 < pi,o, we return the extracted ball to the urn 
together with Dip = u (£1,1) new red balls. While, if X\ = 0 and zo > p 2,0, we return it to the 
urn together with 1)2,1 = it (£2,1) new white balls. If AT = 1 and zo > p 1,0, or if X\ = 0 and 
zo < P2,o, the urn composition is not modified. To ease notation, let denote wi,o = l{z 0 <pi 0 } 
and 1112,0 = l{z 0 >P2 o>- Formally, the extracted ball is always replaced in the urn together with 

AiDi,iwi,o + (1 — Ai) 1)2,11112,0 

new balls of the same color; now, the urn composition becomes 

Ti,i = 1/1,0 + Ai_Di,iwi,o 

< 

+2,1 = 1/2,0 + (1 — AT)D 2 ,iiH2,o. 

Set Vi = +1,1 + +2,i and Z\ = Y 1 _1 Yi,i. Now, by iterating the above procedure we define pi,i 
and p2,i to be two random variables, with pi,i, p2,i £ [0,1] and pi,i > p2,i a.s., measurable with 
respect to the u-algebra T\ = where Q\ = cr(Ai, AT£i,i + (1 — AT)^2,i) and <pi is 

a r.v. independent of Q\. Let m 1 = f u (y) pi (dy) and m2 = f u (y) p2 (dy) be the means of 
{Di,„,;n > 1 } and {D2, n \n > 1 } respectively. 

The urn process is then repeated for all n > 1 . Let pi t „ and p2,n be two random variables 
with pi,n,p2,n £ (0,1) and pi, n > p2,n a.s., measurable with respect to the c-algebra T„. = 
a(Gn,y\,—,y>n), where 

Qn = a (Ai, Ai6,i + (1 - Ai) 6,1, A„, A„fi, n + (1 - A n ) &,»), 

and ip„ are a collection of r.v. independent of Q n . We will refer to p^ n j = 1,2 as threshold 
parameters. 

At time n+ 1 , a ball is extracted and let A„+i = 1 if the ball is red and A n +i = 0 otherwise. 
Equivalently, we can define A„+i = 1 {u n+ 1 <z n }, where U n +1 is a uniform random variable in 
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( 0 , 1 ) independent of J ~ n , £1 and £ 2 - Then, the ball is returned to the urn together with 
X n +lDl, n +lWl t „ + (1 — A'„ + l) D2,n+lW2,n 

balls of the same color, where Di,„+i = u(£i,„ + i), D 2 ,n+i = u{&,n+ 1), Wi, n = l{z„<pi, n }, 
W 2 ,n = l{z„>/3 2in } and Z n +1 = Ti,n+i/Tn+i for any n > 1 , where 

Yi.n+l = 2/1,0 + Efc/ XiD^iW^i-! 

< 

Y 2 ,n+1 = 1/2,0 + E?=l (1 - X i) D 2 ,iW2,i -1 

and y n+ i = Yi.n+i + Y 2 , n +1- If X n+1 = 1 and Z n > pi,„, i.e. Wi, n = 0, or if X n+ i = 0 
and Z n < p2,n, i.e. W2,n = 0 , the urn composition does not change at time n + 1 . Note that 
condition pi,™ > p 2 ,n a.s., which implies Wi, n + W 2 ,n > 1, ensures that the urn composition 
can change with positive probability for any n > 1, since the replacement matrix is never a zero 
matrix. Since, conditionally to the cr-algebra J- n , X n +i is assumed to be independent of £1,2(2, 
X n +i is Bernoulli distributed with parameter Z„. 


2.1 Weak consistency of the urn composition 

A particulary relevant result of this paper is concerned with the consistency of the urn proportion 
Z n when the random thresholds pi, n and p2, n converge in probability to some constants in 
pi, p 2 £ ( 0 , 1 ). To obtain this result, we need to assume that the thresholds sequence are 
bounded away from 0 and 1 with high probability, which is expressed in the following condition: 
there exist two constants 0 < p m in < p m ax < 1 and 0 < c p < oo such that 

F* (pmin P2,n ^ Pl,7i — Pmax) ^ 1 exp ( CpTL ) ( 2 . 1 ) 

for large n. Hence, we can establish the consistency result as follows 


Theorem 2.1 Assume EU) and there exist two constant pi,p 2 £ ( 0 , 1 ), with pi > p 2 , such 
that 

pl,n -4 pi p 2 ,n 4 p 2 . (2-2) 


Then, when mi 4 m 2 , 



yp2 


if mi > m2, 
if mi < m 2 . 


( 2 . 3 ) 


We present the proof of Theorem 12.11 in Section [ 4 ] 


Remark 2.2 The strong consistency of the urn proportion presented in Ghiglietti et al. (see HOI /), 
i.e. pi,n —> pi implies Z n 14' pi, may suggest to prove Theorem \ 2 . 1 \ by applying subsequence 
arguments. Specifically, Z n -4 pi in E3J implies that for any subsequence {n*,; k > 1} there ex¬ 
ists a further subsequence {nkj',j > 1 } such that Z nk 14' pi. Moreover, assumption pi, n -4 pi 
in ( 12.211 guarantees the existence of > 1 } such that pi,n k . -4 pi. Nevertheless, the 

strong consistency result in m does not prove that Z „ k . 14 ' pi with the only assumption that 
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Pi,n k . -4 pi, because this condition does not provide any information on the behavior of pi,i at 
times i (m, .;j > 1 }. Hence, the convergence of pi ,would imply the convergence of Z„ k , 

J Kj Kj 

only if the urn composition was updated exclusively at times {nk d ',j > 1}. 


2.2 Strong consistency of the urn composition 

The following theorem states the consistency of the urn proportion Z n for any values of mi and 
m2, when the random thresholds pi, n and p2, n converge with probability one. 


Theorem 2.3 Assume there exist two constant pi,p2 € [ 0 , 1 ], with pi > p2, such that 


P 1,1 


P i 


Then, 



„ a.s. 

P 2 ,n ~> p 2 - 

( 2 . 4 ) 

pl 

if mi > m2, 


Zoo 

if mi = m2, 

( 2 . 5 ) 

p 2 

if mi < m2, 


P(Zoo 

£ [P 2 ,pi]) = 1 . 



We present the proof of Theorem m in Section [o] When the limit of the urn proportion 
is different from 1 or 0, the following convergence result on the total number of balls to the 
smaller mean holds. 


Lemma 2.4 Assume ( 12 . 41 ) with pi > p2 and let m* = min{mi,m,2}. Then, on the set 
{linin-nx, Z n ^ { 0 , 1 }}, 

Tn a.s. * 

- —> m . 

n 

The above lemma can be applied for the RRU model only when mi = m2. For the case mi 4 m2 
in an RRU model, May and Flournoy ( 2009 ) established in (see [ 14 ]) that — ^ 4 ' max{mi; m2}. 
In the case mi = m2, we are able to establish that the limiting proportion Zoo has no point 
mass within the open interval (p2, pi). This is stated in the following lemma. 

Lemma 2.5 Assume ( 12 . 41 ) with pi > p2 and mi = m2 = m. Then, for any x £ (p2,pi), we 
have P(Zoo = x) = 0. 

Point masses of probability are possible at values pi and P2. 


2.3 Asymptotic distribution of the sampled balls 

The second order asymptotic results of the proportion of sampled balls are concerned with 
the concept of stable convergence (see El): which provides a particularly elegant approach to 
martingale central limit theory. Formally, let {X„; n > 1 } be a random sequence on a probability 
space (TL,jF, P); thus, we say that X n —> X (stably) if, for every point x of continuity for the 
cumulative distribution function of X and for every event E £ T, 

lim P ( X n < x, E ) = P ( X < x, E ). 
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We now present the asymptotic distribution for the proportion of sampled balls in an RRU 
model. Let us denote by Ni n := -Xi and N 2 « :== (1 —-fo) = n—Ni„ the number of red 

and white balls, respectively, sampled form the urn up to time n. Moreover, let af := Var[Di,i] 
and a\ := Var^.i]. The result is the following 

Theorem 2.6 Consider an RRU model and assume mi = m 2 = m. Then, 

A A/"(0, E), ( stably) 

where 

^oo(l — ^ 00 ), E (1 — Z 00 )o'i + Zoocr 2 • (2-6) 

We now present the asymptotic distribution for the proportion of sampled balls in an ARRU 
model. This result can be derived by Theorem l2.6l on the set of trajectories that do not cross the 
thresholds py„ and p 2t „ infinitely often, and hence { Z 00 ^ {p 2 ,Pi}}- To this end, we introduce 
a sequence of random sets {A„;n > 1 } such that A n £ J~v. and A n C A n + 1 for any n > 1 , and 
U„>i A n = [p 2 , pi). In particular, we fix 0 < a < 1/2 and we define A n as follows: 

A„ := (p 2 + CY~ a , Pl - CY~ a ) , (2.7) 

where 0 < C < 00 is a positive constant. The choice of { A n ;n > 1} in (12.71) allows us to 
apply the estimates of Lemma 13.61 in the proof of the limit distribution, in order to obtain the 
equivalence: { Z n £ A n ,ev.} = { Z 00 £ (p 2 ,pi)} a.s., where ev. stands for eventually, which 
means for all but a finite number of terms. The limit distribution for the ARRU model is 
expressed in the following result. 

Theorem 2.7 Assume (12.41) with pi > p 2 and mi = m 2 = m. Then, 

lim n {Z„ £ A„} = lim„{Z n £ An} = {Zoo £ (p 2 ,pi)}, 
and, on the sequence of sets ({ Z n £ A n },n > 1), we have 

z °°^) A AT(0, E), ( stably) 

where, as in (12451) . 

■Zoo(l Zoo), := (1 — Zoo)ai + Zoo(?2• 

It is worth noticing that the limiting distribution obtained in Theorem l2.6l and Theorem 12771 is 
not Gaussian but a mixture distribution. 

As a corollary of the methods of proof of Theorem 12.61 and Theorem l27l one can obtain the 
asymptotic distribution of ,/n(Z n — Zoo). We state this result without proof. 

Theorem 2.8 Assume (12.41) with pi > p 2 and mi = m 2 = m. Then, conditionally on T n , on 
the sequence of sets ({Z n £ A n }, n > 1), we have 

y/n{Z n — Zoo) A Af(0, Ez), ( stably) 

where 

E z := ^1 + -^oo(l — Zoo), E := (1 — Zoo)<Ji + Zoo<r 2 . 
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3 Preliminary results 


In this section, we present some preliminary estimates that are required to understand the 
dynamics of the ARRU model and to prove the main results of the paper. Most of the proofs 
of the results gathered by the literature are omitted, since the original proofs hold for all values 
of mi and m 2 . 

Initially, we show a useful expression of the excepted increments (Z n + 1 — Z n ) conditionally 
to the story of the process T n , which is required to prove the consistency result and in particular 
in the proof of Theorem 14.21 in Section [4] 

Lemma 3.1 For any n > 0, 

E [Z n +1 — Zn | J~n] — Z n (l — Zn)B Ul 


B n ■— E 


■Dl,n+lWl,n D2,n+1 W2,n 

_Y n + D\,n+lWl, n Y n + -D2,n+1 
Proof. The proof of this Lemma is based on a modification of the proof of Theorem 2 in |15) 
First, note that, by definition 

ry -.r Yl,n + -Dl,n+lWl,» . rr \ Tl,n 

Y*n+1 A-n+l—r~ . 1 , 7J7 I (.1 , . 777 

Yn + El }n +lWl,n Yn + U 2 ,n + l\V 2 ,n 

X„+i is conditionally to T„ independent of Di, n +i and D 2 , n +i, we can get that 


■En 


and since X n +i 

E[Zn+l\E, 


= E 

= E 


Yl,n + Dl,n+lWl,n , , ^ ry \ Ll, 

Yn + Dl,n + lWl, n _ n>V “ n " 


Yn + L>2,n+lW2,n 


\En 


Analogously, we have that 
E[l-Z n +l\En] = 
Therefore, 


Fl,n + Hl,n+1 Wl,n Y2,n \ 

Yn + Dl : n+lWl,n Y n + Z?2,n+1 Wi,n ) 

/■1 ry \ f Y2,n 4“ Ll2,n+1 IT2,n Tl,n 

. _ V Yn + D2,n + lW 2 ,n Yn + L>l,n+lWl,n 

E[Z n +1 — Zn\J-„] = E[( 1 — Zn)Z n +1 — Z n ( 1 — Z„-f-l)\E„] 

in Tir \ ^ 


\En 


1 l,n + Lll,n+lH l,n I 2 ,n 

Yn + fll,n+l Wl,n Y n + I?2,n+1 W2,n 


— Z n (1 — Zn)E 

Y2,n + L>2,n+lH / 2,Ti Vl, 

V71 + f? 2 ,n+lVF 2 ,n Vri + -Dl.n+lTTl,, 

= Zn{ 1 - ZrO-E [ — L>1 ’" + lW ' 1 T ’" - .. ^ 2, n +1 ^2,» ^ 


■\En 


This concludes the proof. 


* * i,n r ' z,n 

h'n + Dl.n+lIFl.n Y n + D2,n + lW2,n 


Now, we show that the number of balls sampled from the urn Ah, n , N 2 ,n and the total 
number of balls in the urn Y n , increase to infinity almost surely. To do that, we first need to 
show a lower bound for the increments of the process Y n , which is given by the following: 


Lemma 3.2 jlDi Lemma 4-1] For any i > l, we have that 


E[Y 


Y ,] > 


f min{yi, 0 ;y2 ,o} \ 

V 2/o + (* - 1) b ) ' 
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This 


Here, we present the lemma on the divergence of the sequences Y„, Ni, n and A^n- 
result is obtained by using the conditional Borel-Cantelli lemma. 

Lemma 3.3 UOl Lemma f.2] Consider the urn model presented in Section [H Then, 

(a) Y n a -4' oo; 

(b) min{iVi >n ; N 2 , n } -4 oo. 

The following lemma is needed in the proof of Theorem 12.31 This result provides multiple 
equivalent ways to show the almost sure convergence of a real-valued process. We consider a 
general real-valued process {Z n \n > 0} and two real numbers d (down) and u (up), with d < u. 
The result requires two sequences of times tj(d, u ) and Tj(d, u ) defined as follows: for each j > 0, 
tj(d,u) represents the time of the first up-cross of u after Tj-i(d,u), and Tj(d,u) represents the 
time of the first down-cross of d after tj. Note that tj(d,u) and Tj(d,u) are stopping times, 
since the events {tj(d, u) = k} and {rj(d,u) = fc} depend on { Z„;n < A;}, which are measurable 
with respect to Pk- 

Lemma 3.4 J3 Theorem 2.1] Let {Z n ;n > 0} be a real-valued process in [0,1]. Let r_i(d,u) = 
— 1 and define for every j > 0 two stopping times 

{ inf{n > Tj-i(d, u) : Z n > u} if {n > Tj(d, u) : Z n > u} 0; 

+oo otherwise. 

, (3-2) 

I inf {n > tj(d,u) : Z n < d} if {n > tj-i(d,u) : Z n < d} ^ 0; 

Tj(d,u) = 1 

+oo otherwise. 

Then, the following three events are a.s. equivalent 
(a) Z n converges a.s.; 

(b) for any 0 < d < u < 1 , 

lim P ( tj{d,u ) < oo) = 0; 

i—*oo 

(c) for any 0 < d < u < 1, 

P (tj+i(d, u ) = oo\tj(d, u) < oo) = oo; 

i>i 

using the convention that P (tj+i(d,u) = oo| tj(d,u) < oo) = 1 when P ( tj(d,u ) = oo) = 1. 

The following lemma provides lower bounds for the total number of balls in the urn at the 
times of up-crossings, Y±, . The lemma gets used in the proof of Theorem l2.3l where conditioning 
to a fixed number of up-crossing ensures to have at least a number of balls Y n determined by 
the lower bounds of this lemma. This result has been taken by Lemma 2.1 of [3j and the proof is 
omitted since the adaptive thresholds and the values of mi and mz do not play any role during 
up-crossings. Hence, the proof reported in Lemma 2.1 of [3] carries over to our model, with D n 
replaced by 
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Lemma 3.5 J3[ Lemma 2.1] For any 0 < d < u < 1, we have that 


Y ^( u 0-- d )\ Y 

Y tj(d , u) > I y *- 


l(.d,,u ) ^ ••• > 


u (1 — d) 


Y t 


t 0 (d,u)- 


(1 — u) y 

The following lemma provides a uniform bound for the generalized Polya urn with same 
reinforcement means, which is needed in the proof of Theorem 12.31 


Lemma 3.6 Lemma 3.2] Consider an RRU with mi = m 2 . IfYo > 2b, then 

for every h > 0. 

Finally, we present an auxiliary result that provides an upper bound on the increments of 
the urn process Z n , by imposing a condition on the total number of balls in the urn Y n . 


Lemma 3.7 


m Lemma 3.1] For any t £ (0,1), we have that 
1 - e N 


Y n > b 


U { \Zn+l — Z n \ < e } . 


(3.3) 


4 Proof of weak consistency and related results 

In this section, we prove the weak consistency for the urn proportion of the ARRU model, 
which is established in Theorem O This proof requires some probabilistic results concerning 
the ARRU model, which have been gathered in different subsections. The proof of the weak 
consistency based on these results is then provided in Subsection 14.41 

Let us start by describing the general structure of the proof. The weak consistency is proved 
by showing that the process {A n ; n > 1}, defined as 

A n := |pi - Z n |, V n > 0, (4.1) 

converges to zero in probability. To prove this, we want to exploit the fact that, unless A„ is 
arbitrarily close to zero, the conditional expected increments of A n are negative. This result is 
obtained in Subsection S3] by studying the conditional expected increments of Z n . Hence, to 
show that A n is asymptotically close to zero, we need to investigate the expected increments 
of the process {A n ; n > 1}. Since the increments of A n are at the same order of Y~ x , we first 
determine how fast the total number of balls in the urn, Y n , increase to infinity. This is addressed 
in Theorem lull where we show that the total number of balls in the ARRU model increases 
linearly with the number of extractions from the urn. For this reason, the increments of A n 
are of the order of n -1 ; hence, we consider differences of A n evaluated at linearly increasing 
times, i.e. G{n,c) := (A„+ nc — A„), such that the L\ bounds obtained for such differences do 
not vanish as n goes to infinity. More specifically, we provide a negative upper bound for the 
expected differences G(n, c), which is not negligible unless A n is asymptotically close to zero. 
Formally, for any 5 > 0, we show that for some 0 < C < 00 

E[G(n,s s )] < -CP(Q(S,n)) + o(l), (4.2) 
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where 0 < ss < oo is an appropriate constant and Q(5,n) := {A n > $}. To obtain (14.21) . we 
prove that the expected differences G(n, ss ) are: (i) negative for moderate values of A„ (see 
Theorem 14.51) : (ii) negligible for small values of (see Theorem 14.61) . These results are derived 
using comparison arguments with specific auxiliary urn models. Finally, in Subsection 14.41 we 
use (TOll and other preliminary results to establish the weak consistency. 

4.1 Harmonic moments of Y n 

In this subsection, we establish that the total number of balls in the ARRU model increases 
linearly with the number of extractions from the urn. Moreover, this result ensures uniform 
bounds for the harmonic moments of the total number of balls. 

Before presenting the main result, we introduce some notation. For any 0 < c < C < oo and 
for all n > 0, let F n (c, C) e F„ be the set defined as follows 

F n (c, C) := {y 0 + cn < Y n < y 0 + Cn}. 

Here, we show that, for some c and C, P(F n (c,C)) converges to one exponentially fast, which 
implies P(Ff)(c,C),i.o.) = 0. Moreover, this result provides uniform bounds for the moments 
of n/Y„. The following theorem makes this result precise. 

Theorem 4.1 Under assumption (12.11) . for any 0 < z m i n < p m in and p max < z m ai < 1, there 
exists e z > 0 such that 


P (Zinin < Z n < z m ») > 1 — exp(—e z n). 
Moreover, there exist 0 < ci < C\ < oo and e y > 0 such that 

P(yo + cm <Y n <y 0 + Cm) > 1 — exp(— e y n). 


(4.3) 


(4.4) 


for large n. As a consequence, for any j > 1 


sup 

n> o 



< oo. 


To ease notation in the rest of paper, we will refer to F n as 


(4.5) 


Fn ~ {yo + cm <Y n <yo + Cm}, (4.6) 

where 0 < ci < C\ < oo are the constants determined in Theorem roi to obtain (1X41) . 

Proof. Let c m i n := min{p m j n ; 1 —Pmax}, fix an arbitrary 0 < c < c m in and consider the following 


A d , n := l [J {Zi< c} 

I n/2<i<n 




Pi {c < Zi < i ~ c} 

n/2<i<n 


A 


u,n 


U > 1 

n/2<z<n 
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In the proof of Theorem 3.1 in m, it is proved that P(Ad, n ) and P(A Ujn ) converges exponen¬ 
tially fast to zero, provided that for some ei, £2 >0 


P (Pl.n > Pi + Cl) 

< c 0 exp (-nef) , 

(4.7) 

P (p2,n < p2 ~ £2) 

< Co exp (—ne\) • 

(4.8) 


Thus, setting ei and e 2 such that pi + ei > p max and p 2 — £2 < Pmm and using m , we 
can follow the same arguments obtaining that, for any 0 < c < c m j n , P(Ad : n) and P(A UiU ) 
converges exponentially fast to zero, which naturally implies (TOll since Zmin < C Pmin ^ Cmin and 

•2rnax ^ Pmax ^ 1 Cmin* 

Now, we prove dpi) . Since the reinforcements are a.s. bounded, i.e. \Dj,„\ < b for any n > 1 
and j = 1, 2, we trivially have that P ( Y n > yo + nb) = 0. Thus, we will show the exponential 
decay of P ( Y n — yo < ci n). Moreover, since from (14.31) for any 0 < c < c m in there exists t z such 
that P (A C:n ) > 1 — exp(—e z n) , we will focus on the probability P ({ Y n — yo < cin} D {M Cjn }). 
First, consider the following relation on the increments of the total number of balls 

Yi - Yi -i = D^XiW^i-! + D 2 ,i (1 - Xi) W 2 ,i -1 > a [XiWij-i + (1 - X t ) W 2 ,i-i] 

Then, note that, on the set A c , n , the random variables 

XiWi,i-i + (1 - Xi) W 2 ,i- 1 , i = n/2,.., n 


are, conditionally to the cr-algebra Pi- 1 , Bernoulli with parameter with parameter greater than 
or equal to c. Hence, if we introduce { Bi',i > 1} a sequence of i.i.d. Bernoulli random variable 
with parameter c, 


P ({Y n - yo < cm} n {A c , n }) < P ({ Y n - Y n/2 < cm} n {^4 c ,n}) 

< P 


< P 


a ^2 Bi < cm > n {A c , n } 

i=n/2 J i 

n I \ 

Cl I 1 


E Bi< - 

Z —' n 


i=n / 2 


Now, we want to use the Chernoff’s bound for i.i.d. random variables in [0,1] (see [7]): 
P (S n < co ■ B[5„]) < exp (- (1 ~ Co) • E[S n 


(4.9) 

where Co € (0,1) and S„ = S ™ =Jl / 2 Bi- In our case, we have £[S n ] = nc/2 and so Co = 2ci/(ac). 
Hence, by choosing ci small enough we can obtain Co < 1 which let us apply Chernoff’s bound. 
This implies (l4~4l) . 

Finally, we get the harmonic moments as follows 


E 


= E 


< E 


Lf„(ci,Ci) 


+ E 


L -F£(= 1 ,C' 1 ) 




K yo + cm 
< cl 3 + yQ 3 n 3 exp (—e y n). 


+ (^J E [ lj7 ^( c i> c i)] 
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4.2 Li Bound for the increments of A n 

For any e > 0, let R(e, n) := {\pi, n — pi| < e} and Q(e,n) := {A„ > e}, where we recall 
from 03} that An = |pi — Z„\. The following result provides an upper bound on the increments 
of A„. 

Theorem 4.2 Let mi > m 2 and assume 03} and (12.21) . For any e > 0, there exists 0 < C 2 < 
00 and a sequence of random variables {■(/)„; n > 0} with U[|^>„|] = o(n -1 ), such that 

E [G{n, n _1 )lQ( Sin) |Jn] < -n _1 • c 2 lQ (e , n ) + if> n , (4.10) 

where we recall G(n, n -1 ) = (A n +i — An). 

The behavior and the sign of the excepted increments of the urn proportion G(n, n _1 ) 
required to prove Theorem 14.21 depend on the position of Z n respect to pi. For this reason, we 
study separately the cases when Z n is above or below pi. Formally, we define 

Q~{e, n) := {Z n < pi - e}, Q + (e, n) := {Z n > pi + s}, (4.11) 

so that Q(e, n) = Q + (e, n) U Q (c, n). Specifically, we present Lemma l4.3l and Lemma S3] that 
provide bounds for the expected increments G(n, n _1 ) on the sets Q~(s,n) and Q + (s,n), re¬ 
spectively. The proof of Theorem l4.2l is presented after the proofs of Lemma f4.3l and Lemma [4.4l 


Lemma 4.3 Let A n £ T n be such that A n C Q ( e,n ). Then, we have that 

E[(Z n+ i -Z n )l An ] > n~ 1 -C 2 P(A n ) - o(n _1 ). (4.12) 

Proof. Let 7„ := E [(Z n + 1 — Z n ) 1a„] and, since A n £ T n , we can use Lemma 13.II obtaining 
/„ = E[E[Z n+ i- Z n \E n ]l An \ = E[Z n (l- Z n )B n l An ], (4.13) 

where we recall that B n is defined in 03} as follows 


B n ■— E 


Dl,n+lWi, n 


L , 2,n+lW / 2,; 


Y n + Dl t n+1 Wl,n Y n + fl2,»+l 1 T 2 ,i 


Fn 


Now, note the following relation 

{Z n < pi,„} D Q~(e, n ) D R(e, n) 

where R(e,n) = {|pi,n — pi| < e}. Since A„ C Q~{e,n), on the set A n the previous relation 
becomes {Z n < pi,n\ 3 R(e,n), which implies Wi, n > 1 u(e,n)- Combining this argument with 
W 2 .J 1 . < 1, we obtain on the set A„ the following inequality 

D 1, 

Ti+l ^-R(e,n) D 2 ,n+1 


Bn > E 


Fn 


fYn + D l,n+llfl(e,n) Y„ + 7?2,n+l y 
Then, by using Z) 2 ,n+ 1 > 0 and Di }n +il n( e ,n) < b a.s., we obtain that, on the set A„ 

/Pl,n + llR(e,n) D 2,n+l 


Bn F E 


V Yn + b 


Yn 


Fn 


= Eln ~ E2 
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where 


mil fl ( e ,„) - m2 m 2 fe 

Pin := - 77 ——-, and E 2n '■= 


Y n +b 


Yn{Y n +b)' 


First, note that 


E [Z n (l — Z n )E 2 nlA n ] < E[E 2n \ < m 2 bsupE 

k> 1 


Now, using (14.511 it follows that 

E [Z n (l — Z n )E 2n l An \ = 0(n~ 2 ). 


Thus, from (14.131) we have 

In > E [Zn(l — Z n )ElnlA n ] ~ o(n *). 
Now, consider the set F„ defined in (14.611 as 


(4.14) 


F n = { an < Y n — yo < Cm } , 

where we recall that, by (14.41) in Theorem 14.11 P(P„) < exp (— e y n). Moreover, let 1 a„ = 
Jin + Jin , where J\ n := lA„nF„ and J 2n := Thus, concerning J 2n we have that 

I E [Z n ( 1 - Z n )E ln Jin] | < max{|Pi„|}P (P n c ) = o{n~ x ), 

n> 0 

since max n >o{|-Ein|} < b/yo a.s. Thus, returning to (1 1.1 II) we have that 

In > E[Zn(l~ Zn)E ln Jln\- Oin- 1 ). (4.15) 


Now, consider the further decomposition Ji n = Jn n + Ji2n, where Jim := lA„nF„n{£i„>o} 
and Jiin := lA n nF„n{Fi„<o}- Thus, concerning J\ 2n we have that 


E [Zn{ 1 - Z n )E ln Ji2»] > - ( - , m . 2 , P (A„ n {Pm < 0}) ; 

\Vo + ci(n + L)J 

moreover, since P(Z n < 2 m in) and P(Z n > z ma x) converge to zero exponentially fast from 
in Theorem HU we obtain 


S[Z B (l-Z B )Pi B J 11 »] > f ^ n(1 (mi ^ m2) V(A„n{Pm>0}) 

\ y 0 + Ci(n + l) / 

Therefore, from (14.151) we have 


o(n J ) 


In > n~ 1 c 2 P (A n ) - 0(ri~ x )P (Pm < 0) - o^” 1 ), 


where 0 < c 2 < oo is an appropriate constant. Hence, since from mi > m 2 we have {Pin < 
0} = R c (s, n), result (14.121) is obtained by establishing P (Pin < 0) —> 0. To this end, note that 


P (Pin < 0) = 1 —P(P(e,n)) —> 0, 

where P ( R(e,n )) — > 1 follows from pi A pi, which is stated in (12.21) since mi > m 2 . ■ 
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Let us recall that from (14.1111 Q + (e,n) = {Z n > p\ + e}. We have the following result 


Lemma 4.4 Let A n G T n be such that A„ C Q + (s,n). Then, we have that 

E [{Z n+1 - Z n ) l An ] < -n~ 1 -c 2 P{A n ) + o(n _1 ). (4.16) 

Proof. The proof of this Lemma is obtained by following analogous arguments of the proof of 
Lemma 14.31 In fact, we can first apply Lemma 13.II then note that 

{Z n < pi,„} C Q +C (e, n) U R c {e, n), 


and 

{Zn > p 2 ,n} 3 Q + (e,n) n R{e,n), 

where we recall that R(e,n) := {\pi, n — pi\ < e}. Hence, since A n C Q + (e,n), on the set A n 
we have that Wi, n < 1 R^(e,n) and W 2 , n > ljj(e,n.), which lead to the following inequality 


Bn ^ E 


Tll,n+1 !«<=(£,n) 


D 2 ,n+llR(e,n) 


4,n+llfl«(s,n) Y n + L> 2 ,n+lli?( e ,™) 


\Tn 


Yn + D 

Then, by applying some standard calculations, we obtain that, on the set An 


B n 


< E 


-Dl,n + ll-R c (e,n) 


■P2,n + llfi(5,n) 


\Pn 


Yn Inf 

_ WT-ilijc(e, 7 i) rn 2 l R ( St „) 

Yn Y n T 

l_R c (e,Ti) VTL 2 \R(e,n) 

= Y n +b ' 

Now, we can go through the same previous calculations using P (Fn) = o(n _1 ), (14.Ill and 
P ( R c {e , n)) —> 0, in order to prove (14.1611 . ■ 


Proof. [Theorem 14.21 First, note that establishing (14.1011 is equivalent to proving that for any 
An G Pn and letting A n := An n Q( e ) n - 


E[G(n, n 1 )1a„] < — n 1 • c 2 P(A n ) + o(n 1 ), 


where we recall that G(n, n J ) = (A„+i — A„). Hence, consider An := A n C\Q + (e, n) and A n := 
A n H Q _ (e, n). Since A+ D A~ = 0 and A„ U A~ = ^4„, we have the following decomposition 


E \G(n, n - 1 )lA„] = /+ - I~, ( 4 . 17 ) 

where 

In : = £^n+l-^n)l A +], I n : = [(-^n+1 — Z„) 1^- J . 

By applying Lemma 14.31 and eu to I n and In , respectively, we obtain 

J In > w _1 • c 2 P{A~) - o(n -1 ), 

< -n _1 • C 2 P(A+) + o(n _1 ). 

This concludes the proof. ■ 
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4.3 Li Bound for A n at linearly increasing times 


In this subsection, we provide an upper bound for the increments of A n evaluated at linearly 
increasing times, i.e. G(n, c) = (A n +nc — A„) and c > 0, where we recall from that 

A n = |pi — Z n \. To this end, we claim that, for any fixed <5 > 0, there exist a value c > 0 such 
that 


P( (I z n+nss -Z n I > 5/2 } n F n ) = 0, 


where we recall from (l4~6l) that F n := {yo + cin < Y n < yo + Cin}. We will denote by ss one 
of these values of c. 

We can compute precisely the range of values admissible for ss : on the set F n , we obtain 


Tl-\-TLC ^ j ib-j-'itu- ^ j 

<&E i<- E U-logU + c), 

Yi ci ' i ci 


n+nc 


— Zi n. 


where we recall that b is the maximum value of the urn reinforcements, i.e. D i >ri , Z? 2 ,n < & a.s. 
for any n > 1. Then, imposing \Z„+„c — Z n \ < 5/2, we obtain 


Si G ( 0 , exp ( 7 ^) - 1 ) ■ (4.18) 

This ensures that P ({| Z n+ns/s ~ Z n | > <5/2} n F n ) = 0. 

The next theorem provides an L\ upper bound for the difference G{n, ss) = (A„+„ aj — A n ) on 
the set Q(5, n) = {A n > 5}. An Li upper bound on the set Q c (5, n) is presented in Theorem l4.6l 


Theorem 4.5 Let mi > m 2 , m and (l2T2l) . Then, for any 5 > 0 there exists a constant 
0 < C < 00 such that 


E[G(n,s s ) l Q(5 , n) ] < -CP(Q(5,n)) + o(l). (4.19) 

Proof. First, note that using (14.41 in Theorem 14. II we have 

\E [G(n, Si)lQ(i !rl )nF=] | < P{Fn) —> 0. 


Hence, define 


Gn E [G(n, ss)lQ(s,n)r\F n ] , 


and consider the following expression 

n-fns^ — 1 

Gn = ]T S[G(t,r 1 )l Q(ain) njr„], (4.20) 

i=n 

where we recall that G(i,i _1 ) = (Ai+i — Ai). From the definition of ss in (14.181 . on the set F n 
we have that for all i G {n,.., n + nss} 


Q(5,n) C Q(5/2,i), 

where we recall that Q(5,n) = {A„ > (5} and Q(5/2,i) = {Ai > <5/2}. Hence, by applying 
Theorem roito each term of the sum in (14.201 . since Q{5, n) r\F n G Fi for all i G {n,.., n + nsi}, 
we obtain 

E[G(i,i 1 )lQ(i,n)nF„] = E[E [G(t,i _1 )lo(« / a,ol- 7r *] ^-Q(S,n)r\F n ] 

— [(“* 1 ' c 21q(S/2,i) + i’i) l< 3 (f,n)nr„] 

= - i -1 • C2P(Q(5, n) n F n ) + E [li>ilQ( 5 ,n)nF n ] ■ 


16 






Now, note that from (14.411 in Theorem 14. II we have that P ( Q(S , n) n F n ) = P ( Q(S , n)) — o(i *); 
moreover, from Theorem 14.211 E [ipilQ(s,n)nF n ] | < E [|^i|] = o(i *). Thus, from (14.201) we have 
that 

n-\-ns§ — 1 n-\-ns§ — 1 

G n < — Y. i -1 • c 2 P(Q(S,n)) + ^2 °(* _1 ) 

i=n i=n 

< - log (1 + s s ) ■ CiP(Q{5, n)) + o(l). 

The result follows after calling C := C 2 log (1 + ss). ■ 

Now, we show that the expected difference G(n, s,s) is asymptotically non-positive on the set 
Q c (5,n), for any <5 > 0, where we recall that G(n,ss) = (A n+rlSi5 — A n ), Q(5,n) = {A„ > 5} 
and A n = |pi — Z n |. The result is stated precisely in the following theorem. 


Theorem 4.6 Let mi > m 2 , (HU and (12.21) . Then, for any 5 > 0, 

Ito„S[G(n,s 5 )l Q c WTl) ] < 0. (4.21) 

To prove Theorem l4~6l we need to compare the ARRU model with two new urn models: 
{Zn‘ n > 1} and {Z~;n > 1}. The dynamics of these processes is based on a sequence of 
random times {t n ;n > 1 } which describes relation between the process {A n ;n > 1 } and an 
arbitrary fixed value v > 0. Specifically, fix v > 0 and, for any n > 0, define the set 


T n := {0 < k < n : Q c (v,n — k)}, 


where we recall Q c (i/,n — k) = {A n _k < u}. Let {t n ',n > 1} be the sequence of random times 
defined as 


tn 


inf {T n } 


if Tn ± 0; 


(4.22) 


I 00 otherwise. 

The time (n — t n ) indicates the last time up to n the urn proportion is in the interval (pi — 
v, pi + v). 

First, let us describe the urn model { Z„ ; n > 1}. Let I~ = 1, yo G (0, yo) and Zg £ (0, pi — v). 
The process {Z~; n > 1}, Z~ = Yi, n /(^i, 71 +^ 2 , 71 ), evolves as follows: if t n -i — 0, i.e. A„_i < v , 
or t n - 1 = 00 , then X n = l. rr ,—, and 


Yl,n — %q ' IJO + XnD\,nI , 

< (4.23) 

Yi,n = (l-Zg)-yo + (l-Xn^D2,n] 

if t n -1 = k > 1, i.e. A n _i > u, then X n = 1 f Un< z n l y an< i 


Yl,n = Yl,n -1 + X n Di tn I , 

< (4.24) 

Yi,n = Y a ,„-1 + ^1 — Xr2j f)2,n 

then, Y n := Yi, n + Y 2 ,n and Z n := Y\, n /Y n . The urn model is well defined since t n -1 is 
Tn -1 -measurable. 
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Analogously, the urn model {Z+;n > 1}, Z+ = Yi in /(Yi,n + Y 2t „), is defined by the same 
equations (14.2311 and (14.2411 . with I~ and zfi are replaced by I + = 1 and Zq £ (pi + v, 1), 
respectively. 

In the next lemma, we state an important relation among the processes {Z^;n > 1}, 
(Z+;n > 1} and the urn proportion of the ARRU model { Z n \n > 1}. This result is needed in 
the proof of Theorem non To ease calculations, let h > 0 and fix the initial proportions z 0 and 
Zq as follows: 

pi — Zq = Zq - Pi = v + h. (4-25) 

Let M„ := Y^i=n 36 ^-R c C,n) an d, for an y e > 0 define the set 

Mn := {M n < ns«se}, (4-26) 

where we recall that R(v, n) = {|pi, n — pi | < v}, sg is such that P ({|G(n, ss)| > <5/2} , F n ) = 0, 
with F n = {yo+cin <Y n < yo+Cin} from (14.611 . Moreover, for any n > 1 and k £ (n,.., n+nss} 
let us define the set 


E(n,k) := U j =n Q c (v,j) = { 3j £ {n, k} : {Aj < v} } . (4.27) 

We also introduce the following notation: A z _ := \pi — 1, A f := \pi — Z+\ and A * := 

max | A i ,A+|. Thus, we have the following result: 

Lemma 4.7 Let m i > m 2 , (EH) and, (12.21) . Fix n > 1, yo £ (0, yo + cm), z 0 and ^q" as 
in (14.251) . Consider the set A4„ as defined in (14.261) with 

0<e<^. (4.28) 

bsg 

Then, for any n > 1 and l n £ {n + 1,.., n + ns,s}, on the set A4 e n D F n we have that 

E(n,l„) C Q c (A*,l) a.s., (4.29) 

for all l £ + 1 ,n + nss}. 


Proof. The proof will be by induction on l £ { l n + 1,.., n + nsa}. First, note that, from the 
definition of {t n ',n > 1} in (14.221) and E(n,k) in (14.271) . we always have 

(f;_i = oo} D E(n, l n ) = 0. 


Hence, we never consider in this proof the set {ti_i = oo}. 

Then, consider the set (t;_i = 0} and note that, from the definition of t n in (14.221) . {t(_i = 
0} = Q c {v, l — 1), which implies that, on the set {t;_i = 0} D {Xi = 0}, 


Zi > 


(pi - i/)Y«i 


Y-i + D 2} iW 2 ,i -1 
and, on the set (ti_i = 0} D {Xi = 1}, 


> 


Zq yo 
yo + D 2 ,i 


= zr 


a.s., 


(4.30) 


Zi < 


(pi + u)Yi -1 + D\,iWi,i-i < ^ 0 + yo + D\,i 


Yi -1 + 


yo + Di,i 


= Z? 


(4.31) 


From (14.3011 and (14.3111 we have Z { < Zi < Z+ a.s., that ensures that (14.291) is verified whenever 
{ti -i = 0 }. 
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To prove (14.2911 on the set {l<f;_i<oo}, we will show that, defining := | Z t < Zij, 
A+ := < Z+j and := M' n n {1 < tj_i < oo}, 

U | A/" n Q + (u,l - ti_i)| |B„)=1, (4.32) 

for any l £ + 1,.., n + nss}. Moreover, from the definition of (t„; n > 1} in (14.2211 . on the 

set {1 < ti -1 < oo}, we note that 


(Xi-tj j = 1} = {Zi- tl _ 1 > pi + u} = Q + (i/,l - ti-i), 

{Xi- tl _ 1 = 0} = {Zi- tl _ 1 < pi - u} = Q~{v, l - ti-i). 

Hence, showing (14.3211 is equivalent to establish the following 

p ({!r n = o}} u {a+ n (x,.*,., = i}} |s„) = 1 , (4.33) 


Now, consider {1 < ti -1 < 00 } Pi { Xi-t l _ 1 = 0}, and by inductive hypothesis let w belongs to 
the set 

(-1 

n ( 4 - 34 ) 

1 

where we recall that A~ = < Z;Note that by (14.3011 it follows that, on the set {ti_i = 1}, 

condition (14.341) is verified. Hence, the result is achieved by establishing that (14.341) implies uj 
belongs to A{~. 

To this end, consider 


Zi = 


1 i,i-i 

Yi-t,-!-! + EL- Il+ 1 + ELi-t,., (1 - Xi) D2,iW 2 ,i-i ' 


Now, note that by (14.3411 we have Xi — l{u i< z i _ 1 y > 1| v< z~ y = X i+1 for any i = l — ti -1 + 
1,...,/. Moreover, since Zi-^^-i > pi — v, > yo and Xi- t ,_ 1 = 0 it follows that 


Zi I 


(pi - v)yo + Z)l = i t , 1+ i 


yo + EL- t|+ i x-Di.Wi,!- 1 + eL,,., (1 - at) ■ 

Note that, letting no such that P(R(is,no)) > rj > 0, for any n > no we have the following 
relation 

{Z n < pi.n} 3 Q~{u,n) D R{v,n), 

where we recall that R(y,n) = {|pi,n — pi| < v} and Q~(v,n) = {Z n < pi — v}. Hence, by 
definition of ti-i in (14.2211 . we have Q~(v,i) for any i = l—ti-i,...,l—l, and {Zi < pi A D R{v, i), 
which implies Wi,t > Iro,,,). Combining this argument with 14' 2.1 < 1, we have that 


Zi > 


{pi ~ v )yo + £*=!-*,!+1 x i DiAR(v,i-i) 


y° 4“ + l X i DiARfai—l) + ) 

In addition, on the set we have that 

1 1 


D 2 A 


y x i DiAR(v,i- 

i=l—ti_ i + l 


i) > 


X) X i D 1,* ~ bM " 

i=l—ti_ i + l 


Z 


> ^ Xi £>i,i — n&s<se. 
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Moreover, condition (14.2811 ensures that 


(pi - v)y 0 - nbs s e > z 0 y 0 , 

which implies Zi > Zfi. This concludes the proof of {Zfi < Z{\. 

Analogous arguments can be followed when we consider {1 < t ;_1 < 00 } Pi = 1}- 

In this case, by inductive hypothesis let u> belongs to the set 

(-1 

f| A+ ( 4 -35) 

i=l-ti_ 1 

where Af = |Zfi > ZiJ. Then, note that condition (14.3511 is verified for t;_ 1 = 1 using (14.3111 . 
Hence, the result can be achieved by establishing in an analogous way that (I4.35|) implies cj 
belongs to A+. 

Finally, combining Af and A ; + , we obtain (14.3311 . This concludes the proof. ■ 

In the next lemma, we show an important result required in the proof of Theorem 1 X 61 
concerning the probability that Z n exceeds an arbitrary threshold l > 0. This result is obtained 
by using comparison arguments between the process (A^;n > 1} and the urn proportion of an 
RRU model, where we recall that A)) = max{A ; “, A/"}, A ; ~ := |pi — Zf\ and A/ - := |pi — Zf |. 
The result is the following, 

Lemma 4.8 Let m\ > m 2 , and 

T n := {k n <tn < 00 } , H„ := j A* > v j , (4.36) 

where {k n ;n > 1} is a deterministic sequence such that k n —> 00 . Fix 0 < yo < 00 and define 
Zg and 2q" as in (14.2511 . Then , 

lim P (h„ U Tn) = 0. (4.37) 

Proof. Since H n = H~ U H+ where 

H~ := \z~ < pi - i/| , and := |z+ > pi + , 

equation (14.3711 is established by proving 

Jim^ P (h~ UT„)+P (H+ U = 0. 

We will show that P (yHT. U T^j —>• 0, since the proof of P (yHT. U —>■ 0 is analogous. 

First, we recall that t n , defined in (14.221) . satisfies that Q c {u,n — t„) = {A„_t n < vj and 
when tn > 0, Q(u, i) = {A; > u} for any n — t n < i < n. Hence, on the set T n the process Z~ 
evolves at times n — t n < i < n as described in (14.241) . yielding X, = 1 and 

Xl,n = z 0 yo + Ei=n-t„+ 1 XiDi l i, 

< (4.38) 

. X 2 7 „ = (l-Zo)Vo + EIU-t n+ i(l -Xi)D 3li . 

Now, consider an RRU model {Zf",j > 1} with initial composition (^yo, V 2 ,o) = ( 'zfiyo , (1 — 
Zq )y Q ); the reinforcements are defined as = Di^ n -t n +j and Trfij = D 2 ,n-t„+j for any i > 1 
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a.s.; the sampling process is modeled by Xj 1 {u^<z^ an d Uj = Un-t n +j a.s., Hence, 
the composition of the RRU model at time j > 1 can be expressed as follows: 

3 

Y {J — y^o + ^ ^ X n —t n +iDl,n—t n +i 

i=1 


Yn 


2,3 


n — t n +j 

= z o Vo + XiDi t i, 

i=n — t n + l 
3 

= V2,0 + (1 ~ Xn-t n +i) P2,n-t n +i 

2 = 1 


(4.39) 


n — t n +j 

= (l-Zo)yo+ ^2 (1 -Xi)D 2 ,i. 

i=n — t n -\-1 


Hence, combining (14.381) and (14.391) with j = t„, we have that on the set T n 


(Y^Y^) = (Y R n ,Y R tn ). 


Now, from the asymptotic behavior of the RRU studied in [15] we have that (since mi > m 2 ) 
P(l im n _Kx> Z R — 4) — 1. Thus, on the set T n we have {limn-Kx, Z R = 1}, which implies 
P U T2j — > 0. This concludes the proof. ■ 

Proof. [Theorem 14.61 First, consider the set F n = {yo + cin < Y n < yo + Cin} defined in (14.61) 
and by using (l4~4l) in Theorem rm we have 


lim nP(FZ) = 0. 


Hence, since \G(n, s«)| < ma x{Z n + nss ; Z n j < 1 a.s., to prove (14.211) it is enough to show that 
for any 0 < h < 1/2 

E [Gn,a ; lQ'(«,n)nF„] < h + o(l), (4.40) 

where we recall that G(n, ss) = (A n + n35 — A n ) and Q(5,n) = {A„ > 5}. Now, define H := [8/h\ 
and note that 

[0,«5] C [0,(H + l)h] = \j£o[ih,(i + l)h]; 

then, calling 

Q((i + 1 )h, n) := Q c ((i + l)h, n) \ Q c (ih, n) = {ih < A„ < (i + 1 )h}, (4.41) 

(where for any two sets A and B, A \ B = A D B c ), we have Q c (5,n) = u|LoQ((* + Y)h, n ) and 
hence the left-hand side of (14.401) can be written as 

H 

E [G(n, Si)lQc(«,„)!-!!?„] = ^2 & \G(n, s«)lQ((i+i)h,n)nF„] > 

i=0 

thus, result (14.401) can be achieved by establishing the following 

E [G(n,ss)lQ(( i+ i)h,n)nF n ] < h ■ P (Q((i + l)h, n)) + o(l), (4.42) 

for any i € {1,.., H}. Now, fix i € (0,.., H}, call v := (i + 1 )h and consider the set A4n := 
{M n < nsge } defined in (14.261) . where we recall that M n = li? c ( v,n)- The left-hand side 

of (14.421) can be so decompose E [G(n , ss)lQr v ,n)nF n ] = Gin + Gin, where 

Gin ■= E \G{n, s«)lQ(^,„)nF rl nAl' ] > an< 4 Gin '■= E ^G(n, S5)lQ(iy,n)nF„n»“] ■ 
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Since P(R(iy,n)) —> 1 from (12.21) , and by using Markov’s inequality we have that 


n+ns s 

P(M e n c ) < e- 1 - V P(R c (u,n)) -»■ 0; 

nss z —' 

x=n 

thus, since | G(n, sa)| < max{Z„ +nS5 ; Z n } < 1 a.s., we have C/ 2 n —> 0 and hence result 114. 4211 can 
be achieved by establishing the following 

Gin = E [G(n, s«)lQ ( „ in)nF .„ nA< e] < h-P(Q(v,n )) + o(l), (4.43) 

where we recall that Q{y, n) = {v — h < A n < v}. 

Now, following the same arguments used to determine ss in (14.181) . we can fix a value Sh 
such that 

P{ {|G(n,a h )| > h/ 2 } n F n ) = 0, 

where we recall that G(n,Sh) = (A n+nSh — A„). Analogously to (14.181) . the range of values 
admissible for Sh is 

s h € ( 0 , exp ~ 1 ) , (4.44) 

where we recall that ci > 0 is a constant introduce in (14.61) to define F n . 

Now, consider the random time tj defined in (14.221 ) as the smallest time k such that Q c (v,n— 
k) occurs, i.e. n — t n indicates the last time up to n the urn proportion is in the interval 
(pi — v, pi + v). Then, call r n := tn+ n3s and note that, since barQ(v , n) C Q c {v, n) by definition 
of Q(is, n), we have that 

P (t„ < nss | Q(v,n)) = 1. 

Hence, define Sir := [sa/s/,] and, assuming wlog that ss = SHShh+1, on the set Q(v, n), consider 
the partition ( 0 ,.., nsa} = , where := {nksh, ■■, n(k + l)s^}; thus, the left-hand side 

of (14.431) can be decompose as Qi n = J2k=o where for any k £ {0,.., Sir} 

'■= E [G(n, S5)lQ(„,n)nF„nAr^n{-r„er fc n }] ■ (4.45) 

Hence, equation (14.431) can be achieved by establishing the following 

Tk < h-P(Q{iy,n)n{r n eT k n }) + o(l), Vfc £ {0,.., S H }- (4.46) 

First, consider k = 0 in (14.461) . From the definition of r„, we have 

{r n £ T^} C Q c {v + h, n + nss), (4.47) 

where we recall that Q c {v + h,n + nss) = {A„+„ Sj < v + h}. Hence, using (14.471) in (14.451) . it 
is immediate to obtain (14.461) . 

For k £ ( 1 ,.., Sh} in (14.461) . from the definition of r n and Sn.fc in (14.271) . we have that 

(r n £ Tk] C E(n, n + n(ss - ksh)), (4.48) 

where we recall E(n, k) = Uj =n Q c (is,j). Hence, we can use Lemma[4]7]with l n = n+n(ss — ksh), 
to obtain, on the set D F n , for any j £ {n + n(ss — ksh ) + 1,.., n + nsa} 

Q c (i/,n + n(s s - ks h )) C Q c (A*,j) a.s., (4.49) 
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where we recall that Q c (v,j) = {Aj < u} and Q c (A*j,j) = {Aj < A*}, A* = max | A J, A J" |, 
A J — \p\ — Z~ | and A+ = |pi — Z+\. In particular, by using (14.4911 and since Q(v,n ) C 
Q(v — h,n) = {A„ > v — h}, from (14.4511 we obtain 

Tk < E |(A„ + „ SJ — v + ^)lQ(i.,n)nF„nAlj l n{'r„er fc n }] ■ (4.50) 

Note that, from the definition of t„ and Tk , we have 

{r n G 7T} C {nksh < t n+nas < n(k + l)sh}. 

Hence, we can apply Lemma r4.8l with k n +ns s = nksh, Tj := | AJ > v | and Hj := {kj < tj < oo} 
as defined in (14.3611 . so obtaining 

E [(A n+7lS5 — u) l{r n eT^*}j 5 P ^ Hn+ns s UTn+nsjj — t 0. 

Hence, applying these results to (14.5011 . we obtain 

Tk < h ■ P {Q(v, n) n (r n G Tk }) + o(l), 

that corresponds to (14.4611 . This concludes the proof. ■ 

4.4 Proof of weak consistency 

Proof. [Theorem 12.11 The result is established by proving that, for any l > 0 and any e > 0, 
there exists no G N such that 

P(Q(l,n))<e , (4.51) 

for any n > no, where we recall that Q(l,n) = {A„ > Z} and A n = |pi — Z n \. To this end, fix 
0 < t < y and 0 < 5 < t to define the conditions 

An := {P(Q{S,n)) <e'}, Bn := {E[An}<2t}. 

It is immediate to see that Bn implies (14.5111 . Thus, (14.5111 can be established by proving that 

(a) for any IV > 1 there exists no > N such that A no occurs; 

(b) there exists no > 1 such that for any n > no An C Bk for all k G {n + 1,.., n(l + s^)}; 

(c) there exists no > 1 such that for any n > no B n C Bk for all k G (n(l + ss ),.., (n + 1)(1 + 

««)}• 

For part (a), we will show that cannot exist IV > 1 such that 

A c n ■= {P(Q(8,n))>e'}, (4.52) 

occurs for all n > N. First, we combine Theorem EH and Theorem Eel to obtain 

E[G(n,s s )] < -c(p(Q{S,n)) - 0, (4.53) 

with 0 < C < oo, where we recall that G(n,ss) = (A n +ns s — A„). Now, if (14.5211 holds, then 
there exists a subsequence {k n \ n > 1} such that, ki — N and k n = fc n _i(l + ss) for all n > 2, 
and by (14.5311 

n n / 

E[A kn ]=Y J E \G{k i -i,s s )]<-Y. ct 2 = ~°°’ 
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where G(fci_i, ss) = (A ki — A ki _ 1 ), which is a contradiction and hence part (a) holds. For 
part (b), consider the time n at which An occurs. Fix k £ {n + 1 ,.., n + ns,s} and note that 
E[ At] < Jin + Jin,k where 


Jin := -E[An], and J 2n ,k ■= E[\A k - A„|]. 


From definition of ss in (14.1811 we have 

J2n,k < E[\ Afc — A„|1 f„] + iSflAfc — An|lF»] 

< <5 + P(FZ), 

and using P(F„) —> 0 from (14.41) in Theorem 14.ll we have that limn->oo Jin,k < <5. Thus, there 
exists no > 1 such that J 2n , k < 2 <S for any n > no- Then, note that Ji n = J-in + Jin where 

J3n •— E[A n lQ c ( 5 ,n)] , and Jin E [An lQ( 5 ,n)] • 

Notice that J^ n < 8P(Q c (8,n)) < 8 and Ji n < P(Q(8,n)) < e', and hence we have J\ n < 8 + e'. 
Thus, combining Jin and J 2n , since <5 < t /3, we obtain for any n> no 

-F^[Afc] < Jin T J2n,fc < 8 -{- t + 2 8 <C 2e , 

that implies (b). For part (c), for any k £ {n(l + ss ),.., (n + 1)(1 + Si)} consider 


E\\ Afc — A„+„ SJ |] < E\\ Afc — An+ns 5 |1f„] + i5[| Afc — An+nsj |1f«]. 


First, note that P(F£) —¥ 0 from (14.41) in Theorem 14.11 Then, since \k — (n + nsi)| < (1 + ss) 
and \Z n +i — Z n \ < b/Y n a.s., we have that 

P ({\Zk-Zn+ns s \> ( y(J+Cin ) (! + S «)} 0 F -) = °‘ 

Thus, for any k £ {n(l + ss ),.., (n + 1)(1 + ss)} we have 



(4.54) 


Now, since B n C An U C„, where C n = ( B n D An), part (c) is established by proving that there 
exists no > 1 such that, for any n > no, 

(cl) An C B k for all k £ {n(l + ss), .., (n + 1)(1 + ss)}; 

(c 2 ) Cn C B k for all k £ (n(l + s s ), .., (n + 1)(1 + s 5 )}; 

For part (cl), we can follow the same arguments of part (b), except for J 2n ,k since here k £ 
{n(l + ss), .., (n + 1)(1 + S{)} and hence 


J2n,k < £7 [| Afc — An|lF„] + E\\ Afc — A„ | 1f= ] 

< i5[|Afc — An+ns a |1 f„] + £[|A„+ns 5 — An|lF„] + P(F„) 
<£[|A fc -An + n, a |lF„] + S + P(F^); 


However, by using (14.541) . we still have limn->oo J 2 n,k < 8 and so, analogously to part (b), there 
exists no > 1 such that J n 2 < 2<5 for any n > no. Since J\ n does not depend on k, (cl) follows. 
For part (c2), we combine (14.531) and An to obtain 


E[G(n,s s )] < -C | 


(4.55) 
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where we recall that G(n, ss) = (A n+7lSi5 — A„). Moreover, by (14.5411 there exists no > 1 such 
that E[ |Afc — An+ns^l] < Cj for any n > no. Hence, (c2) follows by combining (14.541) . (14.5511 
and B n as follows: 

E[ A fc ] < E[\Ak — A„+ nS5 |] + E[G{n,s s )] + E[ A„] = 2e'. 


Remark 4.9 It is possible to present a modification of the current arguments along the tradi¬ 
tional probabilistic lines. We chose to present the above alternative logical argument. 


5 Proof of strong consistency 


In this section, we provide the proof of the strong consistency of the urn proportion Z n for any 
values of mi and m 2 , when the random thresholds pi t „ and p 2 ,n converge with probability one. 
Proof. [Theorem 12.31 We divide the proof in three steps: 

(a) P ( p 2 < li m n Z n < lim n Z„ < pi ) = 1, 

(b) 

{ P(lim„Z„ > pi) = 1 if mi > m 2 , 

Pflim, Z n < P 2 ) = 1 if mi < m 2 . 

(c) P ( lim„ Zn exists ) = 1. 

For part (a), firstly note that, when pi = 1 and P 2 = 0, result (a) is trivially true, hence 
consider 0 < p 2 < pi < 1. We show that JP(lim„Z„ < pi) = 1, since the proof of P( \hn „Z n > 
P 2 ) = 1 is completely analogous. To this end, we show that cannot exist e > 0 and p' > pi such 
that 

P (\im n Z n > p'i) > e > 0 . (5.1) 

We prove this by contradiction using a comparison argument with an RRU model. The proof 
involves last exit time arguments. Now, suppose (EU) holds and let Ai := (lim n Z n > pi}. Let 

Ri := | k > 0 : p M > Pl ^ Pl | , 

and denote the last time the process {pi, n ;n > 1 } is above (pi + pi) /2 by 

J sup{f?i} if Ri 0; 
t p'i+pi = t 

2 0 otherwise. 


Since pi : „ 'Ll’ pi by (12.41) . then we have that P P ' 1 + P1 < 00 ^ = 1. Hence, there exists 


n e £ . 


such that 


-P I t p'.+pi > n £ ) — 


(5.2) 


Setting B\ := > n e j- and using (15.21) . it follows that 

e < P(Ai) < e/2 + P (Ai n Bl) . 
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Now, we show that P (Ai n Bf) = 0. Setting 


Ci = | w £ n : lim„Z„ < Pl * Pl j , 
we decompose P {A\ D B{) as follows: 

P (Ai n Bf) < P(Ei) + p(b 2 ), 


where E 1 =A 1 D B'{ n Ci and E 2 = Ai n Bf n Cf. 

Consider the term P (E 2 ). Note that on the set C'{, we have | lim „ Z n > Pl j[ P1 | and on 
the set Bf we have {p+n < Pl ^ P1 } for any n > n t . Hence, since Bf fl C+ D B 2 , on the set B 2 
we have that Wi, n = l{z n <pi,„} 0. Then, letting rw := sup{fc > 1 : Wi,k = 1} we have 
P(E 2 Cl {rw < 00 }) = P(E 2 ) and, on the set E 2 , for any n > rw the ARRU model can be 
written as follows: 

^ 1 , 71+1 = Yl ,T\\r 

< 

. Y 2 ,n +1 = Y 2 , tw + (1 - Xi) D2,i, 

where = 0 for any i > rw, and W 2 ,i-i = 1 because W 2 ,i-i + W 2t i-i > 1 by construction. 

Now, consider an RRU model {Z R -,i > 1} with initial composition (Y R 0 ,Y-^ 0 ) = (Yi , Y 2 ~ w ) 
a.s.; the reinforcements are defined as D fV = 0 and D 2i = D 2 , TW +i for any i > 1 a.s.; the 
drawing process is modeled by X '^_ 1 := 1< zR] and = U TW +i a.s., where {B„;n > 1} 

is the sequence such that X n +i = 1 {u„<z„} for any n > 1. Formally, this RRU model can be 
described for any n > 1 as follows: 

vR _ vR _ y 

C 1,77 + 1 — *1,0 — U,7W 

< 


. Y 2 R u +1 = Y 2 r 0 + Er=o (1 - X?) D*i = + E?=C +1 (1 - Xi) D 2}i . 

Hence, on the set E 2 we have that for any n > rw 


(Yi,n,Y 2 , „) = (Yi R n _ TW ,Y 2 R n _ TW ). 

Since from [15! P(\im n Z R = 0) = 1, on the set E 2 we have that {lim n Z n = 0}. This is 
incompatible with the set Ai which includes E 2 . Hence P (E 2 ) = 0. 

We now turn to the proof that P (Bi) = 0. To this end, let 

7 , - inf {t>n, : {z« < h±£i} n {il > y-X— 

and note that, since by Lemma 13.31 Y n “4' 00 , P(Ci fl {r e < 00 }) = P(Ci). Moreover, on 
the set Bf we have that {/5i, n < Pl t, P1 } f° r any n > n e . We now show by induction that 

on the set Bf Pl Ci we have { Z n < p\ Vn > r e }. By definition we have Z Te < Pl j[ pi . and 

by Lemma 13.71 this implies Z Te +i < p \; now, consider an arbitrary n > r e ; if Z n < Pl ^ P1 , 

then by Lemma 13.71 we have Z n +1 < p \; if Pl ^ P1 < Z n < p\ we have lLi, n = 0 and so 

Zn +1 < Zn < p[. Hence, since Bf fl Ci C Bi, on the set Bi we have {Z„ < p\ Vn > r e }. 
This is incompatible with the set Ai which also includes E\. Hence P (Bi) = 0. Combining all 
together we have e < e/2 + P (Bi) + P (E 2 ) = e/2, which is impossible. Thus, we conclude 
that P(Al) = P(lim n Z„ < pi) = 1. 
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For part (b), wlog we assume mi > m 2 to show that P(lim„Z„ > pi) = 1, since the proof 
of P( \im „Zr,. < P2) = 1 when mi < m 2 is completely analogous. To this end, we now show that 
cannot exist t > 0 and p' < pi such that 

P (lim„Z„ < p'i) > e > 0. (5.3) 


We prove this by contradiction, using a comparison argument with an RRU model. Now sup¬ 
pose (15.31) holds and let A 2 := {lim n Z„ < p'{\. Let 

R2 := | k > 0 : p M < Pl + Pl J , 

and dehne the last time the process {pi,n\ n > 1 } is less than (p[ + pi) /2 by 

j sup{i? 2 } if R2 ^ 0; 

T p\ +pi ~ 1 

2 0 otherwise. 


Since pi, n ^4' pi, then we have that P ^r p ' l+P1 < 00 ^ = 1. Hence, there exists n e £ N such 


that 


P[r^>n.) < -. 

Setting B 2 := |t p / +p1 > n e | and using (15.41) . it follows that 


(5.4) 


t < P{A 2 ) < e /2 + P(A 2 nB%). 


Let E 3 := A 2 Pl i? 2 - We now show that P (£ , 3)=0. On the set A 2 , we have nim „^n < pi} and 
on the set B 2 , we have {pi,n > Pl \ P1 } for any n > n e . Hence, on the set E 3 we have that 
Wi : n = ^{z n <pi n 1 ^4 1- Then, letting rw := sup{fc > 1 : Wi,„ = 0} we have P{E$ Pl {rw < 
00 }) = P(i? 3 ). Now, analogously to the proof of P ( E 2 ) = 0, we can use comparison arguments 
with the RRU model to show that on the set E 3 we have {lim n Z n = 1}. This is incompatible 
with the set A 2 , which also includes E 3 . Hence P (E 3 ) = 0. Combining all together we 
have t < e/2 + P (E 3 ) = e/2, which is impossible. Thus, we conclude that the event 

A 2 = {\ivcinZn > pi} occurs with probability one. 

For part (c), note that, combining (a) and (b), we have shown that 

P(\\m n Z n = pi) = 1 if mi > m 2 , 

' P{p 2 < lim n Z n < lim n Z n < pi) = 1 if mi = m 2 , (5-5) 

Pdim^Zn = p 2 ) = 1 if mi < m 2 . 

Therefore, if the process {Z n -,n > 1} converges almost surely, we obtain (12.51) . Wlog, assume 
mi > m 2 , since the proof of the case mi < m 2 is completely analogous. 

First, let d, u, 7 and p} (d < u < 7 < p\ < pi) be four constants in (0,1). Let {rj(d, u);j > 1} 
and {tj(d,u)-,j > 1} be the sequences of random variables defined in (13.211 . Since d and u are 
fixed in this proof, we sometimes denote Tj ( d , u ) by 17 and tj (d, u) by tj. It is easy to see that 
T n and tn are stopping times with respect to {P n ; n > 1}. 


27 









Recall that, by Lemma [3.41 we have that for every 0 < d < u < 1 
Zn converges a.s. P ( t n (d,u ) < oo) —i 0, 

OO 

n+l{d, u) = oo| t„(d,u) < oo) = oo. 

71 = 1 

Now, to prove that Z n converges a.s., it is sufficient to show that 

P ( tn(d , u) < oo) -> 0, 

for all 0 < d < u < 1. Suppose Z n does not converges a.s.. This implies that P (t n < oo) }, <j>\ > 

0, since P ( t n < oo) is a non-increasing sequence. We will show that for large j there exists a 
constant <j> < 1 dependent on tj> i, such that 

P (tj +i < oo| tj < oo) < (j). (5.6) 

This result implies that P (tn+i = oo| t n < oo) = oo, establishing by Lemma[3]4]that P (t n < oo) 
converges to zero as n goes to infinity, which is a contradiction. 


Consider the term P (t;+i < oo|t; < oo). First, let us denote by r p ' the last time the process 
pi, n is below p[, i.e. 

{ sup{n > 1 : pi, n < pi} if (n > 1 : pi,„ < pi} ^ 0; 

0 otherwise. 

Since pi, n -4 pi, we have that P y P [ < ooj = 1. Hence, for any e 6 (0, |) there exists n e € N 
such that 

■±-P ( Vi > ne) < e. (5.7) 

By denoting Pi (•) = P (-| ti < oo) and using U <n < ti+ i we obtain 

P (ti +1 < oo| ti < oo) < Pi (t; < oo). 


Hence 

Pi ( Ti < oo) < Pi Ti < oo} n {r p / < Tie}) + Pi (t^ > Tie) . 
We start with the second term in (15.811 . Note that 


(5.8) 


(Vi > 


< 


(t p[ > ne) P ( Vl > « E ) 


<(>1 


< e, 


P (ti < oo) 

where the last inequality follows from (EH). 

Now, consider the first term in (15.811 . Since the probability is conditioned to the set {ti < oo}, 
in what follows we will consider the urn process at times n after the stopping time ti. Since we 
want to show (15.611 for large i, we can choose an integer i > n e and 

b 


i > log u(i-d) 


VM7-«) 


so that 

(i) U > i > n e a.s.; 
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(ii) from Lemma [3.51 we have that Y Ti > 6/ (7 — u) a.s. 

These two properties imply respectively that, on the set {n > ti} 

(i) pi,n > pi, since from {r p < < n e } we have that n > r p /; 

(ii) Zt i £ (u, 7 ), since 1 < u and > u and from Lemma [3.7l we have that \Z n — Z n - 1 | < 

(7 ~ «)• 

Now, let us define two sequences of stopping times {t„',n > 1} and {r£;n > 1}, where 
represents the first time after t„-i the process Zq+n up-crosses p}, while t* represents the first 
time after t* the process Zt i + n down-crosses 7 . Formally, let tq = 0 and define for every j > 1 
two stopping times 


* J inf{n > Tj_i : Z ti+n > pi} if {n > t* : Z ti+n > pi} ^ 0 ; 
= 


+00 


otherwise. 


(5.9) 


„ I inf{n > tj : Z ti+n < 7 } if {n > tj-i '■ z ti+n < 7 } 7^ 0; 

Tj = 1 

+00 otherwise. 

Note that, since Z t . +T ->_ 1 > 7 and Z ti+T • < 7 , from (ii) we have that Z t .+ T * £ (- 11 , 7 ). 

For any j > 0, let { Z '! rl ; n > 1} be an RRU model defined as follows: 

(!) ( y i,o> y 2,o) = ( y i, 7 +T;, y i,t 4 +r; 2-t-d ) a - s -’ which im P lies that z o = 

( 2 ) the drawing process is modeled by XL, = l, r .j = 3 ,, where U 3 +1 = U t -+ T *+n+i a.s. 
and U n is such that X n = 1 {u n <z n _ 1 y, 

(3) the reinforcements are defined as D 3 2n+1 = D 2 + i + T *+n+i+(m 1 — m 2 ), D 3 ln+1 = £>i !ti+r * + „ + i 
a.s.; this means E[D{ n ] = E[D 3 2 n ] for any n > 1; 

(4) the urn process evolves as an RRU model, i.e. for any n > 0 


Yi n+ 1 ^Yi n +xi + 1 Di in+1 
Yi n+1 =?i n +(1 - xi +1 ) 

\zj _ \rj I \zj 

I n -\-1 — 2 l,n+l ~Y~ 1 2 , 


n +1 J ^ 2 , 71+1 1 


,n+l 
y-i 
r l,n+l 


!,n+l? 


7 3 

n+1 y. 


We will compare the process {Z),; n > 1} with the ARRU process {Zti+n', n > 1}. Note that at 
time n, we have defined only the processes Z 3 such that r* < n. 


We will prove, by induction, that on the set { 77 ' < n e }, for any j G N and for any n < t}+\ — r/ 
■^n < ^ti+T?+») y 2 '„ > ^.ti+rf+n, ^ljn < +»■ (5.10) 

In other words, we will show, provided that ti > r p / , that for each j > 1 the process is 
always dominated by the original process Z tj +T » +n , as long as Z t .+ T * +7l is dominated by p) (i.e. 
for n < t*j+i — Tj). By construction we have that 

d + u 


Z J o~ 


< u < z t .+ f, — F 1>ti+ r; 
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which immediately implies Y£ 0 > Y 2}ti+T *. To this end, we assume (15.1011 by induction hy¬ 
pothesis. First, we will show that Y 2 J n+1 > Y 2 tt . +T ? +n +i. Since from (15.1011 Z J n < Z ti+T *+ n for 
n < tj + i — Tj , by construction we obtain that 


Xl., = 1, 


+ 1 — ^l t/ t i +T*+n + l<' Z t i +T*+n} A ti+T^ +n+ 1- 


= *£. 


As a consequence, since WAi < 1 for any n > 1, we have that 


Y 2 


2,t i +T*+n+l ^-2,t i +T*+n 


i) — — Atj+rj'+n+l^ T>2,£ i +r*+n + ll'F2,£ 


< (1 -Xi +1 )D^ n+1 

= (yL +1 - Yin) , 


which, using hypothesis (15.1011 . implies Y £ n+1 > l 2 ,t i +T*+n+i- Similarly, we now show that 
?p n+ 1 < Ti,t i+T *+n+i. We have 




ti+T?+n+ 1 f l,£i+T-*+n 


= Ah, 


ti+T, ? +"+l^l.*i+T*+n-(-l yy 1 ,tj+rf +n 


WT, 


From (i) we have that, as long as Z remains below p\, Z is also above the process pi,n- Since 
we consider the behavior of Z ti+T * +7l when it is below p[, i.e. n < Tj +1 — f}, we have that 
W 1 ,t i + r r+n = 1- Thus, 


Y 


+ «+l 


- Y 


l,*i+T?+nj A 


-^+1 


d; 


n+1 



which using hypothesis (15.1011 implies Y / n+1 < Y liti+ . r *_|_ n+1 . Thus, we have shown that, on 
the set {t p / < n e }, for any n < t * +1 - t*, Z J n+1 < Z t . +T * +n+1 , Y { n+1 < Yi >t . +r . +n+1 and 
^ 2 ,n+l ^ ^2,^+Tj+n+l hold. 


Now, for any j > 1, let Tj be the stopping time for to exit from (d,u), i.e.: 

inf{T 2 3 } if J ? 3 7 ^ 0 ; 

Too otherwise, 

where i ?3 := {n > 1 : Z 3 n < d or Zj{ > u}. Note that, on the set {r p / < n e }, 


U AT*{ “ f i { Z n-r; } < d } } 


{Tj < oo} = | inf { Zt i+n } < dj C 

C {U°i 0 {Tj < oo}} . 

Hence, by denoting Pi (•) = P (}ti < oo) and E , [■] = E \-\ti < oo], we have that 


(Vi < oo} l~l {t^ < n e }) 


< Pi 


< 


({U“L 0 {Tj < oo}} n {r pi < n e }) 

Y Pi ({ T t < °°} n (Vi ^ n S) > 


i =o 

and, by setting h = , each term of the series is less or equal than 


» M sup |Z£ - Zg| > ft } D {r pi < He} ) < Pi ( sup \Z 3 n - Z J 0 \ > h j . 
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Note that {Zn > 1} is the proportion of red balls in an RRU model with same reinforcement 
means. Then, by using Lemma [3.61 we obtain 


Pi [ S up\Z 3 n -Z 3 \ >h 

\n> 1 


= Ei 


< 


Y t * 


sup I Z J n - Z 3 0 \>h 

n> 1 


4 2 

h? + h 




T i+*i 


Moreover, by using Lemma [3.51 the right hand side can be expressed as 


Ei 


_b_ 

Y t , 


Pi(l— 7) V ( 4 | 2 


7(1-Pi) 


h 2 


Since by Lemma [3.3i yj, converges a.s. to infinity, and since t; —> oo a.s. because Ti > i. we have 
that Ei [Y^T 1 ] tends to zero as i increases. As a consequence, we can choose an integer i large 
enough such that 


which by setting <j) 


Ei 


Y t „ 


4 2 

h? + h 


1 ~ Pi 
1 - Pi/7 


1/2 + e implies (15.611 . 


i.e. 


< 


1 

2 ’ 


P (ti + l < Oo|ti < oo) < <f) < 1 . 


This concludes the proof. ■ 

Proof. [Lemma 12.4] We divide the proof in two parts: 

(i) mi ^ m 2 and 0 < p 2 < pi < 1; 

(ii) mi = m 2 and 0 < p 2 < pi < 1, on the set { Z ^ ^ {0, 1}}; 

For part (i), assume mi > m 2 , since the proof in the case mi < m 2 is completely analogous. 
In this case m* = m 2 and, by using Theorem 12.31 we have Z n "A' pi; thus, since f> 2 ,n —P 2 
and pi > P 2 , denoting by r € N the last time Z n crosses pi, n , i.e. r := sup{fc > 1 , Z^ < P 2 ,k}, 
we have that P(t < 00 ) = 1. Then, since {t < n} C {VF 2 ,fc = l,Vfc > n}, we use the following 
decomposition, on the set {r < n}, 
y 1 n 

= -Y(l-X i )D 2 ,iW 2 ,i-l = W 0 ,n+Wl,„, 

n n ' 

1=1 

where 

1 T 

W 0 ,n := - V(1 - Xi)D 2 ,i(W 2 ,i -1 - 1), 

n z ' 
i=l 

1 " 

Wi,„ - V(l- Xi)Da,i 

n ' 

X = T 

Since P(r < 00 ) = 1, we have Wo,n -4 0, while since 

E[(l - Xi)D 2i i\Ti-i] = (1 — Zi-i)m 2 “4- (1 — Z 00 )m 2 , 

we have that 4' (1 — Z oa )m 2 . Finally, since Y n = (1 — Z rl )~ 1 Y 2 ^ n , we have 4' m 2 = 
m*. 
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For part (ii), since m 1 = m 2 = m, by using Theorem [23] we have Z n °3' Z ^ £ [p 2 ,pi]; then, 
on the set {Zac £ ( 0 , 1 )}, we can follow the arguments of part (i), so obtaining 




The proof of Lemma 12.51 is based on comparison arguments between the ARRU and RRU 


model. Specifically, for any no > 1, we consider an RRU process {Zk(no)’,k > 0} coupled with 


the ARRU process {Z no +k',k > 0} as follows: the initial composition is (Ti,o(no), Y 2 fi(no)) = 
(Ti,n 0 , Y 2 ,n 0 ) and for any k > 1 



(5.11) 


where AT(no) = 1 ^ <g !(?t. 0 )}• Th® relation between Zk{na) and Z no+ k required in the proof 
of Lemma E3] is expressed in the following result. 

Lemma 5.1 For any no,ni > 1, we have that 


!\ = 1 {p2,n 0 + fc — Zn 0 +k < Pl,n 0 +k } C Plj.Ljl Z no +k — Zk{jl o) }. (5.12) 


Proof. First, consider the dynamics of the RRU process {Zk{no)~,k > 0} expressed in (15.1111 
and the dynamics of the ARRU process {Z no +k', k > 0} expressed as follows: 



(5.13) 


where X no+ k = l{u k <z nQ+k _ 1 }• Hence, ( 15.1211 follows by noticing that for any 1 < k < ni 

{p2,no~{-k A Z n Q-^-k T pi,no+fc } U {fUl,no+fc —1 — m2,riQ+fe—1 — 1}- 

■ 

Proof. [Lemma 12.51 The proof is structured as follows: we assume there exist x G ( p 2 ,pi ) and 
p > 0 such that P(Zao = x) = p and we show that this assumption leads to a contradiction. 
To this end, fix e > 0 such that p 2 <x — e<x + e<p\ and denote by r G N the last time Z n 
exceeds I t := (a: — e, x + e): formally, 



sup{fc > 1 : Zk £ h ,} if {k > 1 : Zk £ I e } / 0; 


otherwise. 


Since {Zoo = x} C {t < oo} and by (1231) pj,n —> pj 7 e , j £ { 1 , 2 }, there exists an integer 
fco £ N such that, 


P ( {pj,n Ie, Vn > k 0 } n {r < fco} D {Z M = x} ) > 


(5.14) 


Now, by using Lemma 1.5.11 we have that 
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and hence (15.1411 is equivalent to 


P ( {pj,n ^ le, Vn > ko} fl {r < ko} fl (^oo(fco) = x} 'j > l /. 

Finally, the contradiction follows by noticing that by Theorem 2 in [T], for RRU model, we have 
-P(Zoo(fco) = x) = 0. 


6 Proofs of limit distribution of the proportion of 
sampled balls 


We start by presenting the limit distribution of the proportion of sampled balls for the RRU 
model. 

Proof. [Theorem 12.61 Note that 

— Zoo J = Ti„ + T^n, 



where 


Tin ■= n 


- 1/2 
•— on ' 


Nln — Zi -1 j , T2 


- 1/2 
•— on ' 


(Zi -1 — Zoo) ■ 


Now, calling A Zj = Zj — Zj-i and (j A n) := min{ji, n}, we have that 


T 2n =«“ 1/2 ^E(-A^) 

i=l j=i 


— 1/2 


00 jAn 


3= 1 *=1 


= —n 1/2 E0 A n)AZj = — (T^ + T 4n ), 
3 =1 

where, since (j An) = n for all j > n + 1, we have 


T 3 „ := n 1/2 Y jAZj , T 4 „ := n 1/2 (Zoo — Z n ). 

i=i 

Now, by using the Doob’s decomposition A Zj = A Mj + A Aj (see [8]), where E[AMj\Tj-i\ = 0 
and Aj e Tj- 1 , we have Tz n = Ten + Ten, where 


T 5 n ■.= n~ 1/2 Y J jAM j , 

3 =1 


T 6n ■.= n~ 1/2 Y / jAAj. 

3=1 


Then, recalling that 

Vn ^ ^ = Tin — T 4n — T^ — Te n , 

the limit distribution is established by proving the following results: 

(a) T 4n \Tn 4 A/"(0, E a ) (stably), where E a = Z <x) ( 1 - Zoo)(l + 2^-); 

(b) T 6n 4 0; 

(c) (Tin - Te) 4 W(0, E c ) (stably), where E c = Zoo(l - ^oo)^-; 

(d) T 4n + (Tin Ten ) —t A/”(0, E a + E c ) (stably). 
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Part (a) follows from Theorem 1 in Aletti et al. (see [I]) and Crimaldi et al. (2007) and 
Crimaldi (2009) (see |j (Jj). 

For part (b), by using Lemma [3.11 for any j > 0, we have that 

AAj = E[AZj\J-j~i] = Zj—i(l — Zj—i)Bj—i, 

with Wij-i = W 2 J -1 = 1 (since for any j > 1 since the process is an RRU model). By using 
Lemma 2 in [I], we have \Bj-i\ < ciY^l 2 a.s. for some constant ci > 0, and hence 

n n 

T 6n < n~ 1 / 2 '^2j\AA j \ < cin~ 1 / ‘ 2 ^2j Y fJ [; 

3=1 3=1 

in addition, by using Lemma 3 in pQ, we have E[Y ~*-[] < C 2 O — l ) -2 for some constant C 2 > 0 
and hence 

n 

E[T 6 n\ < Cic 2 n~ 1 / 2 '^2j{j - 1 )~ 2 = O (n' 1 / 2 log(n)) . 

3=1 

Thus, (b) follows 

For part (c), let T ln — T 5n = J2j =1 ASj„ where 

A Sjn ■= n~ 1/2 {Xj - Zj-i — jAMj). 


Since (Ti n — T^ n ) is a martingale with respect to the filtration {P n ;n > 1}, we apply the 
Martingale CLT (MCLT) after establishing the following conditions (see Theorem 3.2 in [11]): 

(i) maxi <j< n |A5j„| -4 0; 

(ii) sup^ .E[maxi< 3 < n (AS) n ) 2 ] < 00 ; 

(iii) I2j=i E [(ASj„) 2 \Pj-i] 4 E c . 

For part (i), since \Xj — Zj- 1 | < 1 a.s. and AMj = (A Zj — AAj), we have that 

IAtSjn| < n _1/,2 (|Xj — Zj-i\ + \jAMj\) < n~ 1/2 (l + \j(AZj - AAj)\). 


Now, since |A^y| < 6 Y)_\ and |AA;| < ciL7 _ 2 a.s. by Lemma 2 in [I], we have 
|A5 :)rl | < n~ 1/2 (l + bjY~_\+cijY~J 1 ) a.s. 


Since by Lemma |2~I1 (iYZ 1 ) ^4‘ m _1 , we have sup^j (jYy 1 ) < 00 a.s., and thus lAS^nl ^4’ 0. 

For part (ii), using the relation i5[S] = P(S > t)dt that holds for any non negative r.v. 
S, we obtain 


E 


max (A SjnY 

l<j<n 


< 


n p Q 

Y 

3=1 Jo 


p{{As jn y > t)dt. 


By applying arguments analogous to part (i), we obtain 


n(AS jn f < 2 [{Xj - Zj- 1) 2 + (jAMj) 2 ] 

< 2 [l + 2 [(jAZj) 2 + (jAAj) 2 ]] 

<2 [1 + 2 [ 6 2 (jY-_\) 2 +c\(jY-_\) 2 }}. 
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Thus, by using Markov’s inequality we obtain 

r,,i A c \2 _ , 


Now, since by Lemma 3 in ID SUPj>! E 


< P c ( 

' 3 



,1 3' 

< max < 

1 ; 



\ 4 1 

E 

(x-i 

) 


> nt 


Yj-1 


< oo, it follows that there exists a constant 


C independent of j such that J 0 °° P((ASj„) 2 > t) < Cn 2 and hence 


sup E 

n>l 


max (A Sjn) 

l<j<n 


< sup Cn < C. 

n> 1 


For part (iii), since AM, = A Zj —A Aj, A Aj G J~j—i and hence E[AZj AAj\J-j-i] = (A Aj) 2 , 
we have the following decomposition 

E[{AS jn ) 2 \E^} = \E\Q 2 |JF,_r] + ^O'AA,) 2 , 

where Qj := (Xj—Zj-i—jAZj). Since |AAj| < ciY )” 2 a.s. and by Lemma fe. 41 (iYr 1 ) ^4' m _1 , 
we have that (jAAj) 2 ^4' 0. Thus, ^ X]j=i (iAA ,) 2 ^4' 0 and hence (iii) is obtained by 
establishing 


n 1 n 

J2 E [(A^) 2 !^-!] = -J2 E lQ 2 AEj-i] 4 S c . 


( 6 . 1 ) 


0 = 1 


i=i 


To this end, we will show that E[Q 2 \Tj-i] ^4 £ c . First, note that, since Xj G {0,1}, we express 


AZ? as follows 


AZ, = X, (1 - Zj- 1 ) 


D i j 

‘y~i 


+ (1-Xj) l-Zj -1 


E 2,j 

Yj -1 J ■ 


As a consequence, we consider Q 2 = XjQ 2 ^ + (1 — Xj)Q 2 0 , where, denoting by Mj- i := Yj-i/j , 


Qj,i : = (1 “ ^j-i) ^1 - 
Qj,o ’■= Zj ~i (—1 + 


D 


1,3 


M,_i 

Did 


1 - Z. 


j-i 




J —1 


{Mj -i Dij). 


Mj-i 


Zj~ i 

m^T 


(—Mj -1 + T>2,j). 


Then, since Dij, £> 2 ,, and X, are independent conditionally to .7y_i and using 
BKM,-! - DiJ 2 |X,_i] = (Mj-i - m) 2 + a?, 

S[(-M,_! + T> 2 ,4 2 |X,_i] = (Mj-i - m) 2 + cr 2 , 

we have that 

E[Qj\Tj-i] =Z J - 1 E[Ql 1 \Tj-x] + (1 - Zj-JElQlofc-i] 

= Zj -' (^rr) ■ m)2+ ^ 

+ (1 - Zj-!) (|g) [(M,_ 1 -m) 2 +a 2 2 ]. 

Finally, since by Lemma |2.41 M,_i “4 'm and by Theorem l2.3l Z,_i “4' Z oo, it follows that 

n 

Y^EKASjnf^j-i] °4' £ c = Zoo^-Zoo) 

3=1 

For part (d), the result follows by combining part (a), (c), Crimaldi et al. (2007) and 
Crimaldi (2009) (see 00), and by noticing that (T\ n — T 5 ) G T n . ■ 
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We now turn to consider the ARRU model. The limit distribution for the ARRU model 
can be obtained by Theorem 12. 6 l on the set of trajectories that do not cross the thresholds pi, n 
and p 2 ,n i.o., and hence {Z a0 £ (p 2 ,pi)}• Since this set is not .An-measurable, we consider a 
sequence of sets (A„;n > 1} such that {Z„ £ A„,ev.j = {Zoo £ (p 2 ,pi)} a.s. Specifically, we 
consider the sequence of sets {A„;n > 1} defined in (12.711 as follows 

An := ( P2 + CY~ a , pi - CY~ a ) , (6.2) 

where 0 < C < oo is a positive constant and 0 < a < |. Consider the partition f l = A 1 UA 2 UA 3 , 
where 

Ai := {Z k £ A k ,ev.}, 

A 2 := {Zk £ Ak,i.o.{ D {Zk (jL Ak,i.o.{, (6-3) 

A 3 := {Zk Ak,ev.}. 

The following lemma establish the relation between Aj, j £ {1, 2, 3}, and Zoo- 


Lemma 6.1 Assume mi = m 2 = m and (|2~4|) with pi > p 2 . Then, 
(a) Ai = {Z OO £ (P 2 ,pi)} a.s.; 

(h) P(A 2 ) = 0 ; 

(c) A 3 = {Zoo e {P 2 ,Pi}} a.s. 


The proof of Lemma 16.11 is based on comparison arguments between the ARRU and an RRU 
model presented in Lemma r5.ll This relation is possible when only one random threshold modify 
the dynamics of the ARRU. For this reason, we fix e £ (0, (pi — P 2 )/ 2 ) and we introduce the 
following times 


Ti := sup { n> 1 : Z n > min{p ln ; pi - e} } , 

(6.4) 

T 2 := sup { n>l : Z n < max{p 2rl ; p 2 + e} } . 

Let 7i := {Ti < 00 } and Ti := {T 2 < 00 }. Since pi n ,p 2n and Z n converge a.s., P(7i U72) = 1. 
Then, by comparing the ARRU process with the RRU process defined in (15.1111 we have the 
following result. 


Lemma 6.2 On the set Ti, for any no, k > 1 we have 

{no >71} C | Z k {n 0 ) < Z no+k < pi - e |. (6.5) 

Analogously, on the set T2, for any no, k > 1 we have 

{no >75} C jp 2 + e < Z no+k < Z k {n 0 ) j. (6.6) 

Proof. Consider the dynamics of the RRU process {.Zfc(no);A; > 0} expressed in (15.1111 and 
the dynamics of the ARRU process {Z no +k',k > 0} expressed in (15.1311 . Then, since {no > 
Ti} C {Wi,n 0 +k- 1 = 1} and W2,n 0 +k- 1 < 1 we obtain (16.511 . Analogously, since {no > 75} C 
{W 2 , no +k -1 = 1} and Wi,n 0 +k-l < 1 we have ( 16.61 1. ■ 
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Proof. [Lemma l6.ll First, let A := [p 2 ,pi], to = 0 and define for every j > 1 

{ inf{fc > tj-i : Zk G Ak} if {ft > tj-i : Zk G Ak} =£ 0; 

+oo otherwise. 

j inf {ft > Tj : Zk-Tj (jj) <£ A} if {ft > tj : Z k - Tj (tj) £ A} ± 0; 
tj = N 

+oo otherwise. 

Denoting by To the last finite time in > 1}, we have the following partition fl = 

St U Soo U S r , where 


St ■= {To G {tj, j > 1}} = C\k>T 0 {Zk Ak}, 

Soo := {To = oo}, 

Sr ■= {To G {Tj,j > 1}} = C\k>T 0 {Zk-T 0 (To) G (p2,pi)}. 
Thus, we establish the following result: 


(i) P(S 0 c) = 0, 


(ii) Sr C Ai, and 
(hi) Sr C {Zeo e (p 2 , pi)}. 

For part (i), this result is obtained by establishing that there exists io > 1 such that, for any 
i > io, 

P(ti < oo\n < oo) < i. 

To see this, we recall that by Lemma 13.61 we have, for any h G (0,1), 

e(s»p|z l -z„|> ft ) < A(T + |) < %k~'. 

Thus, by using Lemma [3.61 with h = C(Yo(rj))~ a we obtain 


P(U < oo|Tj < oo) 


= P 


( Uk>iZk(n) ^ [p 2 ,pi] |Ti < oo'j 


< P 

< E 


sup I Zk{rj) - Zo(t,)\ > C(Yo(rj)) \n < oo 


6 b 


Yo (Tj) 


(c(Yo(Tj)y 


\Ti < OO 


= ^2 E [ ( y 0( T f)) 2 “ 1 k* < Oo] , 

and hence the result follows by recalling that 0 < a < i and Yo(rj) = Y Tj > To + ja a.s. 
part (ii), by Lemma 16.21 we have that 


For 


Sr fl 71 C n fc >T 0 {^fc-T 0 (T 0 ) < Zk < pi — e}, 

Sr n 72 C rifc>T 0 {p 2 +e < Zk < Z k -T 0 (To)}. 

Thus, the result follows by P(Ti UT 2 ) = 1 and Zk-T 0 (To) Zoo(To) G (p 2 ,pi). For part (iii), 
from part (ii) we have that 


Sr C {min{p 2 + e, Zoc(To)} < Z a0 < max{pi - e, Zoo(T 0 )}}; 
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thus, the result follows by noticing that 

( min{p 2 + e, Zoo(To)}, max{pi - e, Zoo(T 0 )} ^ C (p 2 ,pi). 

Now, to complete the proof of Lemma f 6 .ll we notice that from (i), (ii) and {^3 = St}, it follows 
that P(_4 2 ) = 0 and {SV = Ai}. Then, combining (iii) and ^3 C {Zoo £ {P 2 ,pi}}, we obtain 
the result. ■ 

We now present the proof of the limit distribution of the proportion of sampled balls for the 
ARRU model. 

Proof. [Theorem 12.71 First, take the sets Ai, A 2 and A 3 defined in (16.311 . Note that, since 
Ai = lim „{Z„ £ A n } and A 3 = lim n {Z„ £ A n }, by Lemma [ 6.11 we have 

lim n {Z n £ A n ] = lim n {Z n G A n j = {Zoo £ (p 2 , pi)}. 

Then, the proof is based on applying Theorem 12.61 to the ARRU model. To this end, consider 
the decomposition {Z n £ A n } = Ain U A 2 n U A 3 n, where Aj„ = {Z n £ A n } D Aj for any 
j £ {1,2,3}. Since by using Lemma 16.21 P(Ao ) = 0 , we have P(A 2ra ) = 0 for any n > 1 . 
Moreover, by definition we have that P(A 3 n ) —> 0 and P(Ain) —>• P{Ai). Thus, calling 
Mn ■= ~ we l lave 

lim P ( Un < x , {Zn £ An} ) = lim P ( Mn < X , Al ) , 

n—> 00 n—> 00 

and since by Lemma l6.2l Ai = {Zoo £ (p 2 ,pi)}, this is equivalent to 

lim P ( Mn < X , {Zoo £ (p 2 , pi)} ). 

n—t 00 

Now, consider the RRU model {Zk(no),k > 1} described in (15.111) coupled with the ARRU 
model { Zn 0 +k, k > 1}. By using Lemma l5.ll for any no > 1, we have 

n£„ 0 {p 2 ,fc < Zk < pi,k } C DfcLi {Z no +k = Zfc(no) }• 

Hence, on this set the ARRU process Z no +k is equivalent to the RRU process Zfc(no); thus, we 
can obtain the limit distribution for the ARRU by applying the limit distribution for the RRU 
expressed in Theorem f 2 T 6 l on the set where the trajectories of the two processes are equivalent. 
To this end, define 

T* := sup{/c>l : {Zk < p 2 ,fc} U {Zk > pi,k} } , 
and note that, for any no > 1 , 

{T* < no} C DfcLi {Z no +k = Zfc(no) }. 

Let 5 be a r.v. with characteristic function £)[exp(^Et 2 )]. Thus, by applying Theorem 12.61 we 
have that, for any no > 1 and any set T £ T, 

lim P ( Mn < x , T D {T* < no} ) = P{ S < x , T D {T* < no} ). 

n—too 

Now, since {Z^ £ (p 2 ,pi)} C {T* < 00 }, we have 

lim P({T* < n 0 } D {Zoo £ (p 2 ,pi)}) = P(Zoo £ (p 2 , pi)), 
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which implies that 


lim P ( Mn < X, {Zoo G (P 2 , Pl)} ) = P( S <X, {Zoo £ (p2, pi)} )■ 

n—¥ oo 

This concludes the proof. ■ 
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